-- Logs begin at Fri 2022-06-24 13:47:09 UTC, end at Fri 2022-06-24 14:47:37 UTC. -- Jun 24 14:14:02.870737 dv-cinder-844601-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 14:14:02.881177 dv-cinder-844601-5-smb devstack@keystone.service[80129]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 14:14:02 2022] *** Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: nodename: dv-cinder-844601-5-smb Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: machine: x86_64 Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: clock source: unix Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: pcre jit disabled Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: detected number of CPU cores: 4 Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: current working directory: / Jun 24 14:14:02.883678 dv-cinder-844601-5-smb devstack@keystone.service[80129]: detected binary path: /usr/bin/uwsgi-core Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: your processes number limit is 47680 Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: your memory page size is 4096 bytes Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: detected max file descriptor number: 2048 Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: lock engine: pthread robust mutexes Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: thunder lock: enabled Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 14:14:02.884255 dv-cinder-844601-5-smb devstack@keystone.service[80129]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 14:14:02.928216 dv-cinder-844601-5-smb devstack@keystone.service[80129]: Python main interpreter initialized at 0x555dd6c719c0 Jun 24 14:14:02.928216 dv-cinder-844601-5-smb devstack@keystone.service[80129]: python threads support enabled Jun 24 14:14:02.928216 dv-cinder-844601-5-smb devstack@keystone.service[80129]: your server socket listen backlog is limited to 100 connections Jun 24 14:14:02.928216 dv-cinder-844601-5-smb devstack@keystone.service[80129]: your mercy for graceful operations on workers is 90 seconds Jun 24 14:14:02.928569 dv-cinder-844601-5-smb devstack@keystone.service[80129]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 14:14:02.928652 dv-cinder-844601-5-smb devstack@keystone.service[80129]: *** Operational MODE: preforking *** Jun 24 14:14:02.928894 dv-cinder-844601-5-smb devstack@keystone.service[80129]: *** uWSGI is running in multiple interpreter mode *** Jun 24 14:14:02.928894 dv-cinder-844601-5-smb devstack@keystone.service[80129]: spawned uWSGI master process (pid: 80129) Jun 24 14:14:02.929096 dv-cinder-844601-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 14:14:02.929677 dv-cinder-844601-5-smb devstack@keystone.service[80129]: spawned uWSGI worker 1 (pid: 80139, cores: 1) Jun 24 14:14:02.929994 dv-cinder-844601-5-smb devstack@keystone.service[80129]: spawned uWSGI worker 2 (pid: 80140, cores: 1) Jun 24 14:14:02.932106 dv-cinder-844601-5-smb devstack@keystone.service[80129]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 14:14:08.470310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:14:08.470310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: from cryptography.utils import int_from_bytes Jun 24 14:14:08.471145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:14:08.471145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: from cryptography.utils import int_from_bytes Jun 24 14:14:08.471269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:14:08.471269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: from cryptography.utils import int_from_bytes Jun 24 14:14:08.471677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:14:08.471677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: from cryptography.utils import int_from_bytes Jun 24 14:14:08.521041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 14:14:08.521255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 14:14:08.521335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 14:14:08.521416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] command line args: [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 14:14:08.521484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 14:14:08.521636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] command line args: [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 14:14:08.521729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 14:14:08.521803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ================================================================================ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 14:14:08.521872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 14:14:08.522057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ================================================================================ {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 14:14:08.522142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] admin_token = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] config_dir = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] admin_token = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] config_dir = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] config_source = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] debug = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.522909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] config_source = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] debug = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.523899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_config_append = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_config_append = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_dir = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.524979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_dir = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_file = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.525969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.526888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.527016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.527131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.527902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.528950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.529058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.529154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.529247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] publish_errors = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] publish_errors = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.530897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.531965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] standard_threads = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] standard_threads = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.532951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] use_journal = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] use_journal = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] use_json = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] use_json = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] use_stderr = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] use_stderr = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.533978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] use_syslog = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.534091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] use_syslog = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.534211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.534342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:14:08.534454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.534580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.534707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.534819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.534934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.535914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.536911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.537655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.538967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.539914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.540954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.541921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.542670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.543937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.544993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.545973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.546942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.547954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.548746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549584 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.549924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.550837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.551868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.552875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.553983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.554928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.555991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.556912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.external = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.external = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.557989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.558118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.password = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.558235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.558351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.token = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.password = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] auth.token = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.559982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.560953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.561905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.562940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.563860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.564903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.565962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.566908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.567984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.568903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.569959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.570905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.571960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.572936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.573884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.574026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.574645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.574761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.574877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.575923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.576894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.577963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.578947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.579870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.580943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.581994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.582906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.583966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.584990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.585997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.586932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.587964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.588944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.589165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.589291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.589408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.589522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.590971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] role.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.591990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] role.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.592899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] role.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] role.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593372 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.593966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.594995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.595920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.596784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.597998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.598989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.599916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.600904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.601994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.602884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.603896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.604980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.connection = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.605997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.606934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.607987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.608957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 14:14:08.609779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:14:08.609779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 14:14:08.641667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.641911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.642002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.642080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.642155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.642231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.650929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.651063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.680751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.680979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.682801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.683033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.827147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.829639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.875974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.876231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.877201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.877434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.941301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.941527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.941666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.942972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.943093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.968913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.969884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.970636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.982504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.982794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.995598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.995779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.995949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.996976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80139) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:08.997106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:14:09.014534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.014743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:14:09.014967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.015082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.015187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:14:09.015268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:14:09.015491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.015583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.015687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:14:09.015780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.015982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.016087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.016272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.016354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.016526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.016775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.027667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.027946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.028232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.028457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.028541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.028730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.028994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.029264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.036813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.037689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.040155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.040434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.040722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.040999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.041271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.041891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.042675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.043589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.043680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.043680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.043953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.044241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.069977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.070767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.071600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.071878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.072406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.072681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.077354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.077702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.077971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.078052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.078365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.078635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.085296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.085574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.086005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.086285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.090645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.090927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.091208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.091448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.091547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.091731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.091814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.092832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.093096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.093358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.112127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.112401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.112722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.112993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.116998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.117769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.120664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.121090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.121447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.121838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.126122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.126805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.129777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.130522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.133474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.133767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.134883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.135027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.135380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.135589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.155059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.155337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.155604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.155876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.156107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.156436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.156701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.156969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.163848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.164813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.165594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.165883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.166507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.166790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.169259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.169561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.169860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.170033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.170161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.170309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.170446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.170583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.170886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.171218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.183801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.184106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.184400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.184595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.184684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.184870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.185159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.185433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.186361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.186662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.186953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.187094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.187381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.187665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.205368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.206053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.208681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.209486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.211997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.212786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.216161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.216331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.216443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.216443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.216634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.216880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.217156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.217431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.223872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.224707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.225520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.226314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.229039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.229326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.229717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.229798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.229996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.230093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.230469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.230743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.239249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.239532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.239810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.240002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.240436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.240709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.247762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80139) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.248051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.248333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.248606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.248689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:14:09.248876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.248964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.249156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.249240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.249428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.249511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.256440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.256575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.256575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.256828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.256937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.257059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80139) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.258667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:14:09.290161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555dd6c719c0 pid: 80139 (default app) Jun 24 14:14:09.291041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555dd6c719c0 pid: 80140 (default app) Jun 24 14:14:09.294191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d85f3-9b24-4511-9793-7998bf199a93 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:09.294482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d85f3-9b24-4511-9793-7998bf199a93 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:09.294763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d85f3-9b24-4511-9793-7998bf199a93 None None] PATH_INFO: `/v3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:09.299013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Fri Jun 24 14:14:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:17.087884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:17.088538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:17.088538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:17.092973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:17.098677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:17.099101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:17.099220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:17.167814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: INFO dbcounter [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] Registered counter for database keystone Jun 24 14:14:17.189186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 14:14:17.195328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writer thread running {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 14:14:17.373069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG passlib.handlers.bcrypt [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80139) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 14:14:17.373393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG passlib.handlers.bcrypt [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80139) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 14:14:17.428786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:17.430419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:17.553871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 14:14:17.715588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:17.785529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: INFO dbcounter [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] Registered counter for database keystone Jun 24 14:14:17.804962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 14:14:17.811890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writer thread running {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 14:14:17.931796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc42a4f-f70b-4212-9f3b-108cc9101f0f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:17.936695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:17.937354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:17.937639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:17.937920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:17.946348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:18.006223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 14:14:18.006495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9be86-3b48-4e73-b2cc-beacbf680a19 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:18.017496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Fri Jun 24 14:14:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:14:18.023423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:18.038979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8061b-58c8-4e3b-b07f-631680b5be26 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:18.043419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:18.044576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:18.044865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:18.045143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] PATH_INFO: `/v3/projects/ece624c61ff74175ac0fde255f3115b8` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:18.049330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] RBAC: Authorizing `identity:get_project(project_id=ece624c61ff74175ac0fde255f3115b8)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:18.100238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING keystone.common.rbac_enforcer.enforcer [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 14:14:18.100834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abddb-9814-4aa8-9050-bac8d2cd2412 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:18.105605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Jun 24 14:14:18 2022] GET /identity/v3/projects/ece624c61ff74175ac0fde255f3115b8 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:20.132871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4aaa-2ff1-41e0-94ad-521109e840e9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:20.133413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4aaa-2ff1-41e0-94ad-521109e840e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:20.133413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4aaa-2ff1-41e0-94ad-521109e840e9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:20.138240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:20.143542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:20.143957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:20.144113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:20.162951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:20.164486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:20.172888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 14:14:20.195598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf4aaa-2ff1-41e0-94ad-521109e840e9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:20.210510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf4aaa-2ff1-41e0-94ad-521109e840e9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:20.215471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:20.216143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:20.216423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:20.216692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:20.224749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:20.226519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4819ef9-1332-454f-8bb4-8f93de4640a4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:20.236012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Fri Jun 24 14:14:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 14:14:20.241593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:20.250691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cd64a-d8ee-43bf-8260-80893fe9dc31 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:20.255033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:20.255889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:20.256206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:20.256481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:20.257886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:20.259768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506a95-79c0-47e3-817c-d9d312309400 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:20.261382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Fri Jun 24 14:14:20 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:22.366751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219de29-d75f-494a-ae50-9d03131a0e06 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.367285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219de29-d75f-494a-ae50-9d03131a0e06 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.367285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219de29-d75f-494a-ae50-9d03131a0e06 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.368681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:22.374330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.374766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.375006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.377421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b134df-db64-4407-91a3-d5f68ce8c67b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.377715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b134df-db64-4407-91a3-d5f68ce8c67b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.377995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b134df-db64-4407-91a3-d5f68ce8c67b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.379288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:22.384409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.384692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.384966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.392670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:22.393860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:22.423955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG passlib.handlers.bcrypt [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80140) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 14:14:22.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG passlib.handlers.bcrypt [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80140) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 14:14:22.470659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:22.472184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:22.476803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:22.499500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:22.522781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:22.572128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:22.595781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:22.602672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a60f-6e43-415e-8d31-b07bbed378f5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:22.636870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:22.637507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.637787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.638062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.695544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50e6c-30cc-4942-9c51-df82683b400f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:22.699188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:22.704435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:22.705914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:22.729865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:22.735564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:22.736633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.736910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.737188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.748642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:22.759670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:22.760639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:22.761985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 8/14] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:22.767563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:22.806492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:14:22.812102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:22.867301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aaaab-803e-483b-8c98-bc9ce938cd4e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:22.900642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520582-f584-468e-9234-c06f3f351ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:22.901317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520582-f584-468e-9234-c06f3f351ace None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.901601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520582-f584-468e-9234-c06f3f351ace None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.901880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520582-f584-468e-9234-c06f3f351ace None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.902624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97520582-f584-468e-9234-c06f3f351ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:22.902927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97520582-f584-468e-9234-c06f3f351ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:22.904409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97520582-f584-468e-9234-c06f3f351ace None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:22.910005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801a9e7-3cb9-4b32-a1cf-7b7d77bc6f6e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:22.916048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 9/16] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:22.922069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520582-f584-468e-9234-c06f3f351ace None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:22.932453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:22.944897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:22.945689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:22.945971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:22.946247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:22.949586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:22.956646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:22.958121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:14:22.979299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:22.980770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:22.981778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:14:22.981778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:14:22.981778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:14:22.981778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:22.981778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 8/17] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:22.986841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:23.022989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520582-f584-468e-9234-c06f3f351ace None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:23.060365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:23.061225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:23.061515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:23.061781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:23.063325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:23.064818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:23.066439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:23.071730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:23.086253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebedb0-6162-490f-b0ac-eef4486ce083 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:23.121672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:23.122329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:23.122608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:23.122881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:23.123595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:23.123901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:23.125328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:23.142578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:23.165275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:23.173379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c1825-da72-4698-a655-a4235e21d6a2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:23.212056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:23.212892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:23.213177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:23.213452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:23.215436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:23.217025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a778a-3fde-43e8-bd7b-f3377b52cda3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:23.223493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:23.225261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:23.269726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:23.340229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e5d66-82c8-47cf-b5a1-3131ff263074 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:23.375156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:23.375911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:23.376178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:23.376457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:23.377296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.domain.id=default, user.id=35fa0e2d0ac94d528972d6e81d01f77b) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:23.377607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:23.379060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979c23a-1049-4be0-9065-a7768c96de41 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:23.387182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1322 bytes} [Fri Jun 24 14:14:23 2022] GET /identity/v3/role_assignments?user.id=35fa0e2d0ac94d528972d6e81d01f77b&scope.domain.id=default&role.id=2f3ba2869328424982c43c608f72cb4e => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:25.588104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388dae1-b3e1-47ad-89ba-195c823c033f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:25.588629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388dae1-b3e1-47ad-89ba-195c823c033f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:25.588629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388dae1-b3e1-47ad-89ba-195c823c033f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:25.590672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:25.605954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:25.606905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:25.607380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:25.610488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f667e-0c11-4425-9e76-579504c6c1ef None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:25.611003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f667e-0c11-4425-9e76-579504c6c1ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:25.611546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f667e-0c11-4425-9e76-579504c6c1ef None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:25.613567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 13/23] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:25.625338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:25.626044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:25.626539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:25.636096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:25.636096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:25.653947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:25.655493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:25.736432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:25.791175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:25.793820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:25.835603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:25.838279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:25.948371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:25.957959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17adb7f-d5e9-4fa7-9689-82ffb058817c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:25.995016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:25.996567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:25.997050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:25.997550 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:25.998493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.000130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c383ec2-cd91-4eae-be65-908223376e1f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.002549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c98c2-4d98-4600-ae14-80b2dff6a7b6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.051787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.052597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.053102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.053581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.064843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.067070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-00eb0d85-ad9e-4764-bef7-ec585f0903cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:14:26.087200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:26.088048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:26.089469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:14:26.089469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:14:26.089469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:14:26.089469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:26.092889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 12/26] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:26.095464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77611-9344-4a13-9a1f-207bddd619ab None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.095971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77611-9344-4a13-9a1f-207bddd619ab None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.096472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad77611-9344-4a13-9a1f-207bddd619ab None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.099024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:26.100109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77611-9344-4a13-9a1f-207bddd619ab None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:26.199011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:26.207089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 15/28] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Jun 24 14:14:25 2022] POST /identity/v3/roles => generated 219 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:26.208754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b2d8-2b1a-4309-a8ea-3511e3543119 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.209046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b2d8-2b1a-4309-a8ea-3511e3543119 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.209321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b2d8-2b1a-4309-a8ea-3511e3543119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.238739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad77611-9344-4a13-9a1f-207bddd619ab None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.253228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b125b2d8-2b1a-4309-a8ea-3511e3543119 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:26.254839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b125b2d8-2b1a-4309-a8ea-3511e3543119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:26.284094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.285917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.286421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.286900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.287901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:26.288532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.290544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaefa1-0853-40e0-bb80-68994f1312e9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.307321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 14/29] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:26.310205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673093f9-8e81-4ff3-a3d1-510452902ab6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.310773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673093f9-8e81-4ff3-a3d1-510452902ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.311307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673093f9-8e81-4ff3-a3d1-510452902ab6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.313039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:26.315899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673093f9-8e81-4ff3-a3d1-510452902ab6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:26.405552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:26.406662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.406971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.407255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.427172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:26.428484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:26.482322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673093f9-8e81-4ff3-a3d1-510452902ab6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.509306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 17/32] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:26.510185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:26.522082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.523095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.523624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.524168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.525197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.527154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.535112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:26.539702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:26.656621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f01cc-1f7e-45a4-a8a5-8abe62ebec68 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.704095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.704924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.705208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.705486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.706214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 16/33] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:14:26 2022] POST /identity/v3/projects => generated 301 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:26.707300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:26.719246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:26.728186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:26.729271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:26.730233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:26.732307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:26.738724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:26.886795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:26.916587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c53bb6-029c-4797-9cb2-e4e914a733a6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.935183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c232-1ca8-428d-ab52-3e9270dceb45 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:26.960581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.961621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.962096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.962581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.963537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.965995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d425ec-53d0-404d-b5f3-845258f40287 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.984497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:26.985074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:26.985355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:26.985631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:26.986393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:26.986700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:26.988494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:26.989749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 17/35] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Jun 24 14:14:26 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:26.999948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5492dc-3fe6-4033-9787-ebc514206f92 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.000335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5492dc-3fe6-4033-9787-ebc514206f92 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.000612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5492dc-3fe6-4033-9787-ebc514206f92 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.002236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:27.007412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 19/37] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:27.012357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.012357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.012357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.014266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.038464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:27.040135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:27.104984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:27.126306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 19/38] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:27.150487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad056e4-2340-4a1c-b830-b61998e90700 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.150772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.188115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.189022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.189396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.189786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.191289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.192947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.194820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 20/39] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:27 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:27.201497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.206189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:27.272460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d502-a225-4c84-86fe-5871e9157ed0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.310015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.310684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.310964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.311240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.311988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.313527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.325240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247fc3-70e3-4bea-891b-8e3a6893c2e9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.328857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Jun 24 14:14:27 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:14:27.365108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.365915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.366197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.366472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.367696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.369213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e496931-0b6d-489d-880c-4f0b8c62391b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.371546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:27.377191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.450902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c44f-c749-48fb-a10e-fa9785850577 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.451084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c44f-c749-48fb-a10e-fa9785850577 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.451376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7c44f-c749-48fb-a10e-fa9785850577 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.453046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 22/42] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:27.458769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.459061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.459346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.478910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:27.480250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:27.536264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:27.563724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:27.568693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:27.592360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.602356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066be8-4689-4eb5-a317-ad5b8be1b755 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.636843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.637743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.638029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.638308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] PATH_INFO: `/v3/domains/default/users/35fa0e2d0ac94d528972d6e81d01f77b/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.640324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=35fa0e2d0ac94d528972d6e81d01f77b, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.641782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.654974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 21/44] 10.222.0.13 () {58 vars in 1361 bytes} [Fri Jun 24 14:14:27 2022] PUT /identity/v3/domains/default/users/35fa0e2d0ac94d528972d6e81d01f77b/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:14:27.692511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f59c2-46da-4f66-b0ab-3580afe0b921 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.729026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.729770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.730053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.730329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.731545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.733065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518fca-22a2-4a05-84d7-a788c1ce54a7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.734742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 24/45] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:27.740841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:27.846443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342cb5-244e-4d43-9841-effbba51fdc5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:27.847988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:27.881302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:27.881967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:27.882253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:27.882529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:27.883246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:27.884752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11646b89-2ea8-442e-a5cd-832faf775587 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:27.910652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:14:27 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:14:29.675748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8e4f-0b70-4171-a8bf-85b1fd45ae64 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:29.676292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8e4f-0b70-4171-a8bf-85b1fd45ae64 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:29.676393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8e4f-0b70-4171-a8bf-85b1fd45ae64 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:29.677747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:29.683411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99898-7c3d-4519-ad88-0df934064acc None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:29.683833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99898-7c3d-4519-ad88-0df934064acc None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:29.683967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99898-7c3d-4519-ad88-0df934064acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:29.701676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-62e99898-7c3d-4519-ad88-0df934064acc None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:29.702880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-62e99898-7c3d-4519-ad88-0df934064acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:29.772693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:29.795605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8e4f-0b70-4171-a8bf-85b1fd45ae64 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:29.864015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:29.900380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8e4f-0b70-4171-a8bf-85b1fd45ae64 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:29.935391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:29.936209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:29.936498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:29.936773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:29.945605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267f9a-eaaf-414d-86bd-465ece8e67e0 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:29.945900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267f9a-eaaf-414d-86bd-465ece8e67e0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:29.946185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267f9a-eaaf-414d-86bd-465ece8e67e0 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:29.947008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:29.947567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 24/49] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:29.953142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:29.953530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:29.953815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:29.955515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:29.956337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:29.957094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 26/50] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:29.962174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:29.972532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:29.974531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:30.042415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 25/51] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:30.062919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b1a82-d519-42bd-a0d4-be24ba0aec8d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.065879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:30.081332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:30.090301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:30.098763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.099428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.099716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.099999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.100777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:30.101086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.102473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.110727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 27/52] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:30.116239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:30.165724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647dc2-47c8-43dc-8397-bcc1d4ccafc5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.201183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.201926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.202176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.202459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.203637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.205154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.206770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:30.212374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:30.218581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774c263-2db2-4e0c-a113-72eda655b0a8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.252599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.253470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.253773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.254035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.255246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.256759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.258431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 28/54] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:30 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:30.264705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:30.303357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:30.322295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba224c-0a49-4366-803a-30da03a92ec2 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.324075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:30.356916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.357586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.357871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.358145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.358850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.360327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.366890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550e40e-dcaf-4ece-9b4b-fe1c63bc369b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.385786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 27/55] 10.222.0.13 () {60 vars in 1140 bytes} [Fri Jun 24 14:14:30 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:14:30.402959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.403773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.404083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.404363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.405633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.407154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0790-f3e3-4940-9d00-2397913b7ffd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.409131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 29/56] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:30.415345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:30.531953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb824d-868e-42b5-89d1-eb2fcb6f8f2f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:30.567437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:30.568140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:30.568430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:30.568710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:30.569554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.domain.id=default, user.id=35fa0e2d0ac94d528972d6e81d01f77b) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:30.569866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:30.571342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008304-715a-4b75-9827-d887deae8136 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:30.573305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:30.578621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1322 bytes} [Fri Jun 24 14:14:30 2022] GET /identity/v3/role_assignments?user.id=35fa0e2d0ac94d528972d6e81d01f77b&scope.domain.id=default&role.id=2f3ba2869328424982c43c608f72cb4e => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:32.433671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840779-c3e9-4038-b6c7-6be55ec96657 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:32.434214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840779-c3e9-4038-b6c7-6be55ec96657 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:32.434214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc840779-c3e9-4038-b6c7-6be55ec96657 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:32.435595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 30/58] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:32.440627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:32.441024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:32.441176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:32.457508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:32.458681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:32.522672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 29/59] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:32.546823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc840779-c3e9-4038-b6c7-6be55ec96657 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:32.646926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc840779-c3e9-4038-b6c7-6be55ec96657 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:32.671473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:32.680497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:32.681274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:32.681558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:32.681835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:32.683610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:32.685105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307a664-6205-4e0a-a947-f18d4fc57ed5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:32.686694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 31/60] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:32.692360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:32.788478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682db58-dede-4a8d-88cf-21e93dbb5769 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:32.813867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:32.821697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:32.822352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:32.822635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:32.823461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:32.824196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:32.825643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ca754-3f76-49d3-87f3-ebc8f8104db0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:32.849440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 30/61] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:32 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:36.043775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4038-b0f3-4a0f-be0e-7281bdbc4a61 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.044782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4038-b0f3-4a0f-be0e-7281bdbc4a61 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.045273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4038-b0f3-4a0f-be0e-7281bdbc4a61 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.047155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 32/62] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:36.052218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.053040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.053545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.081061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:36.082610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:36.113519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e51eb-12cb-4fb5-bc8c-6e37eccef0ee None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.113815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e51eb-12cb-4fb5-bc8c-6e37eccef0ee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.114081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e51eb-12cb-4fb5-bc8c-6e37eccef0ee None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.115456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 33/63] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:36.126837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.127123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.127404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.185610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 31/64] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:36.237962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.274905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:36.277092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:36.370455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 34/65] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:36.411356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4303d-796c-4c1e-9be4-3e73e79e8884 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:36.414321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.428196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:36.451041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:36.452144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.452640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.453056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.467953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-d17fdc72-ba6c-4675-8c06-2d034e2878c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:36.480807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:36.481878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:36.482676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 32/66] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:36.483586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d35-e713-4440-9b46-9bac61843b04 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.483881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d35-e713-4440-9b46-9bac61843b04 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.484196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d35-e713-4440-9b46-9bac61843b04 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.489671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 33/67] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:36.490472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32660d35-e713-4440-9b46-9bac61843b04 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.540765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f31bb-98a6-4017-aef8-1ec863defd8a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:36.565495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:36.577325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:36.578114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.578411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.578669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.588861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-84ea585e-83c5-4229-b29c-801cb38206a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:36.596585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:36.597413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:36.598158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 35/68] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:36.603859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.603859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.603859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.604810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32660d35-e713-4440-9b46-9bac61843b04 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:36.618708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:36.620444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:36.638553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:36.639155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.639474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.639758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.640550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:36.640860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:36.642274 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aabe85-9fba-4a19-ba76-e9ced621f9da None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:36.654466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:36.655693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8750-9c54-4596-a1a0-eb1cd6060f10 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.655984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8750-9c54-4596-a1a0-eb1cd6060f10 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.656294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8750-9c54-4596-a1a0-eb1cd6060f10 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.657541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 35/70] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:36.658620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa27b-3029-4a2a-83e4-72c584b92c20 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.659351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa27b-3029-4a2a-83e4-72c584b92c20 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.659641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daa27b-3029-4a2a-83e4-72c584b92c20 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.661050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 36/71] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:36.661615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa27b-3029-4a2a-83e4-72c584b92c20 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.691645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:36.692801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.710365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:36.776756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daa27b-3029-4a2a-83e4-72c584b92c20 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:36.790865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993f100-01c1-4f90-bab6-f3ee59788135 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:36.804445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:36.810495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:36.811260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.811550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.811834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.812617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:36.812930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:36.814341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb74c-5961-49eb-af82-67390620eb2b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:36.822395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:36.824389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.824701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.824981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.832689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:36.833565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.833851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.834134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.840848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:36.842037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:36.850306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:36.852178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7f150-0b1a-44d1-ba51-341c980ceeab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:36.854480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:36.855653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:36.855944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:36.856248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:36.872129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:36.873309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:36.914417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 38/75] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:36.915187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:36.944545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:36.949703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 38/76] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:36.950538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.032436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d390a-3b4a-41eb-98ef-0cc0f26f5530 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.054103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe39ea-4052-4f59-83c8-5159671d9b7c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.055624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.068190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.069007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.069289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.069560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.079603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:37.087578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:37.088457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:37.089408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:37.090016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.091952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.093068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.093360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.093901 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.095126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.096620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.098252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 39/78] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:36 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:37.099003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.186970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.199371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78125b-7af0-4698-b42d-56a2f8ebd8f8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.201893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4e71-8d35-4980-b057-078ae5cbb9fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.238383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.239035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.239321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.239604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.241790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.242581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.242861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.243133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.254566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:37.262692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:37.263526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 40/79] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:37.269408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.300604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.312176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.313683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.391573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0612bbf-1568-492c-98bf-5d50c2f60120 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.400915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.414006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 40/80] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:37.414843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.434620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.435695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.435985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.436290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.437639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.439034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.440877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 41/81] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:37.441651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.535158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee086e-1da8-4513-be7e-c80098d48933 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.539779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.544295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81807a4-d501-499a-ae27-26279b89114b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.576414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.577084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.577369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.577648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.578402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:37.578715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.580137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.581324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.581969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.582254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.582531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.591500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 41/82] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:37.591500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.645904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.656400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.657890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.697933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509121dd-2aec-4314-a74b-0a89041b660e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.731606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.732434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.732716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.732990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.733738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:37.734043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.735424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.745417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 42/83] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:37.746297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.762891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.768913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 42/84] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:37.769804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.855386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea5faf-6905-4f14-9387-e5e18f709d3f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.868925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:37.879481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372c75f-e41a-4957-9a1d-82fdd47699b9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:37.890806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.891664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.891943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.892248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.893588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.895082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.896834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 43/85] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:37.901667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:37.919579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:37.920464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:37.920745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:37.921024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:37.921737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:37.923211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:37.949797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 43/86] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:37 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:37.950562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.016219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.018137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03f99-7fb7-49da-a07f-3ebf61f96bb2 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.061636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.062533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.062825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.063104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.064412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.065940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.072215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 44/87] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.072215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.079615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d02e01-71f2-49f8-8946-b1aafe308c4a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.120060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.121054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.121340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.121617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.122854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.124436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.126084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 44/88] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:37 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.126845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.139445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.207027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16b13-cc00-4272-a6d5-e798e0262153 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.250711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.251579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.251870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.252180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.253388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.254856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.256587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 45/89] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.257431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.264098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681c0a7-001d-4da5-a914-98b90d3ae7c0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.293032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.313055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.314151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.314446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.315017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.315933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:38.316340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.318877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.334373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 45/90] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.335716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.402873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77eefe-1730-40ea-b6b3-5488d57e1100 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.424490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.446734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.447391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.448331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.448610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.480099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2825-b4fe-41b9-9dc0-3951466a7543 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.524007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.524831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.525214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.525497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.534049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.535559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.604673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.622868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.624718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.670532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:38.671511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.705869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.737052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:38.738173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.832484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:38.849607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e797-9cbc-4bd2-8eae-67b23e5401bb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.875775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa3178-3761-414f-aae6-06cdf67453d3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:38.887859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.889067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.889567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.890037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.891466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.893172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.895606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 47/93] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.896603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:38.940278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:38.940990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:38.941278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:38.941553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:38.942401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=35fa0e2d0ac94d528972d6e81d01f77b) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:38.942712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:38.944197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:38.958202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 47/94] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/role_assignments?user.id=35fa0e2d0ac94d528972d6e81d01f77b&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:38.959164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:39.019242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022e552-f40b-4bc4-a99a-329108d38ffa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:39.060902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:39.061786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:39.062068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:39.062341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] PATH_INFO: `/v3/projects/bcec649b284445c29ea45dfbafaceb3b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:39.063780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] RBAC: Authorizing `identity:get_project(project_id=bcec649b284445c29ea45dfbafaceb3b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:39.065556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:39.067402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 48/95] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/projects/bcec649b284445c29ea45dfbafaceb3b => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:39.073760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:39.082576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:39.101720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:39.116498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0675-d57d-4abf-9d1a-b3663a3b9ead None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:39.161715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:39.162797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:39.163779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:39.164564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:39.165874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:39.166992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:39.168757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2efb0b-92d7-47cf-8d98-bcd13feaf13c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:39.176679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:38 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:39.255424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a439-93ca-475f-8e2a-af1779a529f2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:39.300568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:39.301231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:39.301616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:39.301913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:39.302756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=bcec649b284445c29ea45dfbafaceb3b, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:39.303066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:39.304679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830af37-f027-4a33-a62f-861a204d6bbf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:39.312976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:39 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=bcec649b284445c29ea45dfbafaceb3b&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:40.510588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab904e-25e0-4f51-b70f-41708af301db None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:40.511063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab904e-25e0-4f51-b70f-41708af301db None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:40.511063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab904e-25e0-4f51-b70f-41708af301db None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:40.512494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:40.517834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:40.518649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:40.519069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:40.536918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:40.538307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:40.613997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:40.637498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab904e-25e0-4f51-b70f-41708af301db None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:40.748618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab904e-25e0-4f51-b70f-41708af301db None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:40.792464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:40.793263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:40.793544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:40.793819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:40.810770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:40.818579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:40.819395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:40.820152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 50/100] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:40.825563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:40.848353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:40.937075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd47a-d9d8-4eab-afd9-3efa44865df6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:40.973329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:40.974356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:40.974839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:40.975309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:40.976289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:40.976794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:40.979343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:40.988800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 51/101] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:40.994781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:41.003084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:41.123874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cb20-63a5-4453-b12e-9ba0b701786f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:41.163893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:41.165160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.165644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.166189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] PATH_INFO: `/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.189750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] RBAC: Authorizing `identity:get_user(user_id=457693ad35ac49d99dc3c3ff79f1bd4d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:41.191297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48237d99-f7e8-4673-9efb-d5a480e4eda9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:41.193091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 51/102] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:40 2022] GET /identity/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:41.199263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:41.253083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107176-aef6-4d46-98f6-2f35d64d0df9 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.253407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107176-aef6-4d46-98f6-2f35d64d0df9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.253648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107176-aef6-4d46-98f6-2f35d64d0df9 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.255071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 52/103] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:41.261028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.261310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.261582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.297055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:41.298361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:41.305791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:41.331400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393ada-96c4-4230-87a5-bc4eec487b72 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:41.370873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:41.371533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.371819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.372122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.419985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:41.438971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:41.480879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:41.489448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:41.491561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627e2ee-db9b-4ce3-8dc9-7c0ed96b5aa6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:41.595856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:41.636780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 52/105] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:41.638561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984bc-8320-44f2-8cf9-16428fec5b3c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.639099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984bc-8320-44f2-8cf9-16428fec5b3c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.639567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d984bc-8320-44f2-8cf9-16428fec5b3c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.641541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 53/106] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:41.642544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d984bc-8320-44f2-8cf9-16428fec5b3c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:41.670195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cbdcf-f3c6-4e7b-9033-6a96d69dc1d7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:41.736960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:41.738029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.738312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.739411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.761940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0c49b5e8-65dc-450b-8b92-c3701c1a75e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:41.773029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:41.773859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:41.774679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:41.776310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 54/107] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:41.785493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.785778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.786053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.814528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:41.815904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:41.826404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d984bc-8320-44f2-8cf9-16428fec5b3c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:41.893729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:41.894637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:41.894912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:41.895182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:41.896603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:41.899084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:41.900421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:41.902220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 54/108] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:41 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:41.904004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:41.939594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 55/109] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:41.939946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.003167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.077242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480138d-94bd-4a5d-b23d-4c392770f291 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.093470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb912-08a0-4aaa-afa3-14225cd22f09 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.121492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.122167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.122467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.122750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.123490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:42.123798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.125239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.134315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 55/110] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:42.135717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.142178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.143876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.144229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.144508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.145396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=457693ad35ac49d99dc3c3ff79f1bd4d) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:42.145713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.147195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9ae1e-db66-46f3-be50-cc0e323e01a5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.155330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 56/111] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:41 2022] GET /identity/v3/role_assignments?user.id=457693ad35ac49d99dc3c3ff79f1bd4d&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:42.158140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12cae-9bf2-4a9f-bd48-65d401702bc2 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.158434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12cae-9bf2-4a9f-bd48-65d401702bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.158717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12cae-9bf2-4a9f-bd48-65d401702bc2 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.160315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 57/112] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:42.161919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12cae-9bf2-4a9f-bd48-65d401702bc2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.275401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf32ce-b4cf-4566-916d-f7275c937113 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.300554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.330588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.337517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.338956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.339237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.339557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.341724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.343363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a84b1-11f0-4601-9029-a8cbf5d78bb3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.345744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 56/113] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:42.347044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.347335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.347615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.369699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:42.370902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:42.417011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12cae-9bf2-4a9f-bd48-65d401702bc2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.452073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 57/114] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:42.453802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.464430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.465348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.465628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.465955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.467250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.468833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700060-b754-4ad7-85ee-d2fd7a29515b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.470402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 58/115] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:42 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:42.471826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc7cd-7faa-47bd-ac93-f70a2d3bf3e9 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.476238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc7cd-7faa-47bd-ac93-f70a2d3bf3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.476573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc7cd-7faa-47bd-ac93-f70a2d3bf3e9 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.482429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 59/116] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:42.482429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc7cd-7faa-47bd-ac93-f70a2d3bf3e9 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.581647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc94c5c-b858-4b78-a65f-1f480cf0b733 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.585529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc7cd-7faa-47bd-ac93-f70a2d3bf3e9 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.589440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.603127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.625061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.625827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.626198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.626473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.627187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.628764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee31e52-fc49-44dd-9e21-aea137d2ebd4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.631798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.632894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.633176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.633450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.635470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.637075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:42.639598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 60/117] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:42 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:42.640709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.666777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 58/118] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:14:42 2022] POST /identity/v3/projects => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:42.668267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4b70-62bf-43a2-a241-be299f942da9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.668627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4b70-62bf-43a2-a241-be299f942da9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.669102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4b70-62bf-43a2-a241-be299f942da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.688283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-463a4b70-62bf-43a2-a241-be299f942da9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:42.689961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-463a4b70-62bf-43a2-a241-be299f942da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:42.777097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 59/119] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:42.784862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5949-4f71-4cbc-b9d5-3763bdf7a545 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.785851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b487bea-926c-47e2-b344-0f0797781f1d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.786141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b487bea-926c-47e2-b344-0f0797781f1d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.786418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b487bea-926c-47e2-b344-0f0797781f1d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.792053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 60/120] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:42.792053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b487bea-926c-47e2-b344-0f0797781f1d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.848173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.848982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.849267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.849543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.864068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-fa45463c-aae7-4bd7-ae75-83b290ab9bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:42.874042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:42.874901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:42.875633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:42.876977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 61/121] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:42.878226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.878518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.878799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.898738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:42.899943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:42.924531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.941862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:42.946809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b487bea-926c-47e2-b344-0f0797781f1d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:42.974083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 62/122] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:42.980983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:42.986988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:42.988395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:42.988946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:42.989411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/d4205fe074a44cd3a49b5486cb631936/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:42.991834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, user_id=d4205fe074a44cd3a49b5486cb631936, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:42.993618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.012448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 61/123] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:42 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/d4205fe074a44cd3a49b5486cb631936/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:43.020445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.206348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b2e2-63c5-4ebe-abb0-553397d03f42 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.236494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3e4c-ac1f-46c9-a6b7-8083187ce95b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.260586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.262015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.262507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.263250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.277452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:43.289224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:43.290332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:43.291332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:43.294017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 63/124] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:43.296528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.302621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.302995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.303377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.303758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.304704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:43.305113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:43.307161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.318273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:43.319353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.341293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:43.343716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:43.449742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d60a45-8b15-479c-a8a4-32dc89b4094d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.468303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1d6a6-78c2-4e4d-8011-9cd3759e2b98 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.493303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.494984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.495427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.495848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.497201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:43.497666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:43.499673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.509156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 63/126] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:43.511326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.539456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.540551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.541609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.541915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.565428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:43.573875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:43.574909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:43.575837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:43.577983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 64/127] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:43.578917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.595558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:43.630689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9bb81-3a05-43fc-88f3-ed8e1194550e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.669661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.670792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.671223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.671636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.673059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:43.675184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.677300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 64/128] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:43.678365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.792201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ba5e9-ebea-4043-bb24-d622ef9aba03 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.830222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.831608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.832192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.832798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.834051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:43.834942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:43.836598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.848001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 65/129] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:43.849292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:43.854382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:43.861875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:43.882873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a9f8-afc5-4a5c-a055-dd96b67fc861 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:43.924793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:43.925678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:43.925964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:43.926246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:43.928291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:43.929792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:43.931657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 65/130] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:43.932252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.049444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f3fd-996b-4670-b752-d26baf2a8524 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.119605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813794c-8327-44dc-bc89-257845742554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.120498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813794c-8327-44dc-bc89-257845742554 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.120777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813794c-8327-44dc-bc89-257845742554 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.121052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813794c-8327-44dc-bc89-257845742554 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.122842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813794c-8327-44dc-bc89-257845742554 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.125826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813794c-8327-44dc-bc89-257845742554 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.128691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 66/131] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:44.131382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b15bb-216f-408c-a6ed-15b41e141019 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.133625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813794c-8327-44dc-bc89-257845742554 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.195630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.198908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.200396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.201326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.209522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.211024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.222880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 66/132] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:43 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:44.224074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.263862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:44.265910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:44.319360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813794c-8327-44dc-bc89-257845742554 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.386337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.387539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.388071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.388566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.390622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.392435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.394929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 67/133] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:44 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:44.397928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0913ff-5915-4d47-9df8-50d26a1c33ed None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.398363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.478905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.480798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.481088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.481370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/35fa0e2d0ac94d528972d6e81d01f77b/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.485393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, user_id=35fa0e2d0ac94d528972d6e81d01f77b, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.487138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.515651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 67/134] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:44 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/35fa0e2d0ac94d528972d6e81d01f77b/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:44.516867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.551434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a638-d636-47b3-989b-00f956a739a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.612947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.613690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.613972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.614248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] PATH_INFO: `/v3/projects/bcec649b284445c29ea45dfbafaceb3b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.620978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] RBAC: Authorizing `identity:get_project(project_id=bcec649b284445c29ea45dfbafaceb3b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.622472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350477c-e71a-48a0-baf1-a5236987ff0e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.624624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 68/135] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:44 2022] GET /identity/v3/projects/bcec649b284445c29ea45dfbafaceb3b => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:44.626225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e5e1-abef-40e8-9d88-620f1f09af42 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.626519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e5e1-abef-40e8-9d88-620f1f09af42 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.626920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e5e1-abef-40e8-9d88-620f1f09af42 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.637386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 69/136] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:44.638801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.639093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.639373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.662516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:44.663976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:44.676109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6458ec6-efea-4326-9580-e5736b83ee2e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.676320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:44.684126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:44.721442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.722750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.723248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.723744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/d4205fe074a44cd3a49b5486cb631936/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:44.727916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, user_id=d4205fe074a44cd3a49b5486cb631936, role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:44.730435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:44.751289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 68/137] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:44 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/d4205fe074a44cd3a49b5486cb631936/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:44.752736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.829499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 70/138] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:44.861483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:44.923881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b927-1780-4478-b56a-db78a9296069 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.983559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07733-38b9-4f60-bbef-d83522c28edd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:44.997784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:44.998694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:44.999029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:44.999309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] PATH_INFO: `/v3/projects/bcec649b284445c29ea45dfbafaceb3b/users/d4205fe074a44cd3a49b5486cb631936/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.001366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcec649b284445c29ea45dfbafaceb3b, user_id=d4205fe074a44cd3a49b5486cb631936, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.002992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.031982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 69/139] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:44 2022] PUT /identity/v3/projects/bcec649b284445c29ea45dfbafaceb3b/users/d4205fe074a44cd3a49b5486cb631936/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:45.033696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.034595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.034890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.035173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.043590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.050276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:45.060928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:45.061841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:45.062577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 71/140] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:45.069854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.096905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.188796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6454-10dd-4658-9e29-cc5cf7976368 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.253676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.254367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.254651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.254929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.255692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:45.255999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.257425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d185aa-d502-468c-b4cc-3729ca42d01b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.271601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 70/141] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:45.277764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.296340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447243-dc00-4dbc-a8e5-be592ddb62cb None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.296688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447243-dc00-4dbc-a8e5-be592ddb62cb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.296900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447243-dc00-4dbc-a8e5-be592ddb62cb None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.298443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 71/142] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:45.310382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.310789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.311030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.348284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:45.349710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:45.417614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293d93-d6db-4fc1-8f93-23e1ba64264e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.459409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.460489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.460780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.461060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] PATH_INFO: `/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.462300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] RBAC: Authorizing `identity:get_user(user_id=457693ad35ac49d99dc3c3ff79f1bd4d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.464495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.467034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 72/143] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:45 2022] GET /identity/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:45.473249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.473965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.480175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 72/144] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:45.560400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.589237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.605437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5452-4bdc-4410-8edb-4ff36cefd5af None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.644099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.645074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.645342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.645512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.646744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.648253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.649958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 73/145] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:45 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:45.656465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.749805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca81b-2501-46dd-acab-f9573d8ffd64 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.784742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.785545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.785829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.786105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.787277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.788787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.790409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 73/146] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:45.796322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:45.797926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a566d-f4db-4b16-bef1-05dc0a9dc197 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.848077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.855735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.856674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.856955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.857229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/457693ad35ac49d99dc3c3ff79f1bd4d/roles/cef9b5cb13244b31b74508092d6b1fd3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.859250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, user_id=457693ad35ac49d99dc3c3ff79f1bd4d, role_id=cef9b5cb13244b31b74508092d6b1fd3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.860739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978e15-c505-4168-a3f8-2778fb272677 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:45.878601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:45.892707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:45 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/users/457693ad35ac49d99dc3c3ff79f1bd4d/roles/cef9b5cb13244b31b74508092d6b1fd3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:45.921492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455a92-fecd-459b-8b0f-72d9d326b322 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:45.981349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:45.982874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:45.983358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:45.983878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:45.984856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:45.986607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:46.014253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f9ab-56d8-4843-824f-5d10e7f4219e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.014547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f9ab-56d8-4843-824f-5d10e7f4219e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.014744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f9ab-56d8-4843-824f-5d10e7f4219e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:46.016170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 75/148] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:46.022387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 74/149] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:45 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:14:46.025804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.026091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.026375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:46.061858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:46.063168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:46.169610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 76/150] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:46.206003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:46.336513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83964e76-5f37-4710-92b4-a1b445e5b036 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:46.361912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:46.377497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:46.378352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.378649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.378929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:46.391460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:46.399719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:46.400693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:46.401518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 75/151] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:46.409668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:46.574449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d762a-9398-4731-b133-51ae61646741 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:46.604948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:46.620038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:46.620871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.621408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.621753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:46.622649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:46.623265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:46.624689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:46.635843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 77/152] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:46.641426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:46.761161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec82a-86de-4fe6-a6e8-3ba812d5ee40 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:46.797958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:46.798844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.799125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.799399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:46.800709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:46.802216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:46.803956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 76/153] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:46 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:46.809576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:46.929380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f01f-b571-4a40-a76e-2e5901d2c928 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:46.967054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:46.967761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:46.968048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:46.968331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:47.024767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:47.045893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:47.047406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:47.171793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 78/154] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:47.177323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:47.237886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:47.298871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717c77-b91b-4b1e-b6df-bdf94ab38602 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:47.344958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:47.345823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:47.346105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:47.346380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:47.349256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:47.350805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd0370-1945-4b8d-a204-110f8a33666e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:47.352889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 77/155] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:47 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:47.358784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:47.457607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:47.476643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799f4f-12d1-49ff-8070-695c9f898a88 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:47.517025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:47.517687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:47.517973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:47.518249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:47.519095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:47.519404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:47.520880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9f16d-d1b4-43d9-a906-c2fcdf8e5316 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:47.532815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 79/156] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:47 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:48.012938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e4e-8e52-4cfd-8bc2-4c6c49fb9b32 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.013307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e4e-8e52-4cfd-8bc2-4c6c49fb9b32 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.013498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e4e-8e52-4cfd-8bc2-4c6c49fb9b32 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.014871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 78/157] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:48.029196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdeb8-51f4-48e3-97cd-24190f0fdff5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.029701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdeb8-51f4-48e3-97cd-24190f0fdff5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.029776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdeb8-51f4-48e3-97cd-24190f0fdff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.053633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-16ccdeb8-51f4-48e3-97cd-24190f0fdff5 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:48.054838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16ccdeb8-51f4-48e3-97cd-24190f0fdff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:48.140209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 80/158] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:48.178447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1e4e-8e52-4cfd-8bc2-4c6c49fb9b32 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:48.233005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f7cd-9ef8-4f4e-9a20-83963f6d55bf None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.233279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f7cd-9ef8-4f4e-9a20-83963f6d55bf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.233604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f7cd-9ef8-4f4e-9a20-83963f6d55bf None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.234986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 81/159] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:48.239985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.240326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.240601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.267769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:48.268922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:48.375346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1e4e-8e52-4cfd-8bc2-4c6c49fb9b32 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:48.401295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:48.402516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 82/160] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:48.416223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:48.417109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.417459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.417783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.428738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:48.437537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:48.438420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:48.439323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 79/161] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:14:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:48.444589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:48.444803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:48.466307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:48.623900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a2d61-ec53-4d2c-bfd4-f8528edb9df7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:48.635688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1dde-bd62-438b-bf7b-32e8bc2a6ac5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:48.692780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:48.693752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.694181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.694599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.695528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:48.695988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:48.698132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c0d52-0cc3-4203-9353-d36715ef01ff None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:48.701520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:48.702397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.702677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.702949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.714354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 83/162] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:14:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:48.716008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca1cf-cc20-406d-85a5-ae88991657ae None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.716467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca1cf-cc20-406d-85a5-ae88991657ae None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.716952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca1cf-cc20-406d-85a5-ae88991657ae None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.718851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 84/163] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:48.722858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca1cf-cc20-406d-85a5-ae88991657ae None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:48.725180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5837ea4f-c13a-444a-a3b7-a859a94bee82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:48.733568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:48.734705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:48.735690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:48.744242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 80/164] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:48.744242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:48.744242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:48.744242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:48.781734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:48.782919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:48.882542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:48.905560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:48.921963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 81/165] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:48.922821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:48.972731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca1cf-cc20-406d-85a5-ae88991657ae None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.039002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff95e6-2700-40d3-a816-e6c697bc9c3c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.042499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.043368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.043642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.043910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.047199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.048814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.050573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 85/166] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:48 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:49.051325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.075134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.076090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.076559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.076993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.077933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:49.078377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.080043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.089230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:49.090231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.128436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.193365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5257-5ba1-4135-a38c-befd8ca74f67 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.229222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.229945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.230305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.230652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.244207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38a668-79c0-4562-a333-56693fd548e0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.300370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.301854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.313250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.314138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.314421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.314693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.332409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.340427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.343586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:49.352939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:49.353913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:49.354691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:49.361092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 86/168] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:49.362221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.417531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 83/169] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:49.418373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.520909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332554c0-8fb0-4369-b41d-198f21b409bf None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.547046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42f2e2-294b-4e16-99e7-22ce65eedc3d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.556997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.557895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.558317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.558776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.559722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:49.560263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.561794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.564273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.570768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 84/170] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:49.571742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.641306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.642611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.643193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.643857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] PATH_INFO: `/v3/users/35fa0e2d0ac94d528972d6e81d01f77b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.648848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] RBAC: Authorizing `identity:get_user(user_id=35fa0e2d0ac94d528972d6e81d01f77b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.651647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218e587-715a-48bc-975c-66b65252e372 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.653523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 87/171] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/users/35fa0e2d0ac94d528972d6e81d01f77b => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:49.659229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7776-a88f-440c-b932-48b89919daa4 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.659626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7776-a88f-440c-b932-48b89919daa4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.660001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7776-a88f-440c-b932-48b89919daa4 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.661421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 88/172] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:49.663243 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7776-a88f-440c-b932-48b89919daa4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.686723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c517fe-674e-4fa1-a5e9-27a0c158b50e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.723879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.725062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.725618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.726113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.727807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.730053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.732066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 85/173] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:49.733119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:49.812368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.838484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2d3c-b104-4033-a19e-b9ee053355b5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:49.873316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:49.874288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:49.874771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:49.875237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:49.876456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:49.948128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:49.950025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:49.968694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7776-a88f-440c-b932-48b89919daa4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.024511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.041288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.042198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.042453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.042877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] PATH_INFO: `/v3/users/d4205fe074a44cd3a49b5486cb631936` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.048741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] RBAC: Authorizing `identity:get_user(user_id=d4205fe074a44cd3a49b5486cb631936)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.050373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4538-17a1-4239-8213-dc31571646db None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.052523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 89/174] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/users/d4205fe074a44cd3a49b5486cb631936 => generated 275 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:50.053841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.054272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.054696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.075426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 86/175] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:50.080574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.085161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:50.086530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:50.171442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 90/176] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:50.177141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.197808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5925f6-5212-4a01-aa28-06b4b92234b6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.242896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.243852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.244397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.244857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.245961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:50.246447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.248118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447d4f-e108-4dc1-b2be-fdcf2a3bc07d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.255672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 87/177] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:50.257221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b864-24a6-45af-a1af-47dd2e1bd3d5 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.257687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b864-24a6-45af-a1af-47dd2e1bd3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.258220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b864-24a6-45af-a1af-47dd2e1bd3d5 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.259827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 88/178] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:50.260891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629b864-24a6-45af-a1af-47dd2e1bd3d5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.270756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.298907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.333733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7f98-8566-44ea-bc6d-9634fe9ad038 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.383409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.384151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.385206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.385697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.456500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629b864-24a6-45af-a1af-47dd2e1bd3d5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.477151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.479760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8afd1-4d35-4790-9c97-bd00ded945e1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.500620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.501484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.501765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.502046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.503291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.504873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.506636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 89/179] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:50.507473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.573586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.604121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 91/180] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:50.605621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.605912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.606186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.612141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.622822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6540d-118d-44ef-87ca-e59a530e737a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.634242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:50.635957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:50.675772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.676602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.676882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.677152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.693806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:50.701629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:50.703218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 90/181] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:50.704443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.727725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 92/182] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:50.737043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.823595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00e4b-8e7a-414c-91e1-c37fb60e7db6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.841430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.847997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc5866-36e4-408e-9f77-45f177a718d1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:50.858137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.858733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.859016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.859290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.860145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=35fa0e2d0ac94d528972d6e81d01f77b) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:50.860457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.861900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a49e-f445-45ac-8fd2-15dbac9cc0d8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.867559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 91/183] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/role_assignments?user.id=35fa0e2d0ac94d528972d6e81d01f77b&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:50.869301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab6f9-5eaa-4cfa-9379-d723fc15cc25 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.869588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab6f9-5eaa-4cfa-9379-d723fc15cc25 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.869854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab6f9-5eaa-4cfa-9379-d723fc15cc25 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.872186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 92/184] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:50.872186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ab6f9-5eaa-4cfa-9379-d723fc15cc25 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.884421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:50.885891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:50.886174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:50.886448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] PATH_INFO: `/v3/projects/bcec649b284445c29ea45dfbafaceb3b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:50.887761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] RBAC: Authorizing `identity:get_project(project_id=bcec649b284445c29ea45dfbafaceb3b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:50.889287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:50.895865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 93/185] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/projects/bcec649b284445c29ea45dfbafaceb3b => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:50.895865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:50.897308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:50.991102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ab6f9-5eaa-4cfa-9379-d723fc15cc25 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.013687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814266-0905-4bc8-89c1-a55e3d2a447f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.030609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.031097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.031372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.031693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.032474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:51.032918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.034375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d170c-02a7-419b-85e6-b41ea211a3c5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.044563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 93/186] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.049463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e88c-68eb-490e-aba3-15bcf6031251 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.049754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e88c-68eb-490e-aba3-15bcf6031251 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.051332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e88c-68eb-490e-aba3-15bcf6031251 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.051468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 94/187] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:51.053184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.053184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.053184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.057465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.058955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.059242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.062426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.070865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:51.072141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:51.073761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:51.081219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:51.082080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:51.082847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 94/188] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:51.083481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.115363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.146030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 95/189] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:51.146859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.158823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.202770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11ee7-8b54-4a13-99a3-f87b710a8621 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.240101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.240753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.241037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.241311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.242133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=bcec649b284445c29ea45dfbafaceb3b, user.id=d4205fe074a44cd3a49b5486cb631936) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:51.242442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.244473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ff87-caf7-4b81-a49b-ea0b009aa7ae None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.250174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07b500-5ce9-41ba-8609-e4293d4912a0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.250597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 95/190] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/role_assignments?user.id=d4205fe074a44cd3a49b5486cb631936&scope.project.id=bcec649b284445c29ea45dfbafaceb3b&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.251598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16242-df39-420e-9487-ca54f8834519 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.251886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16242-df39-420e-9487-ca54f8834519 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.252197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16242-df39-420e-9487-ca54f8834519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.269602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-acf16242-df39-420e-9487-ca54f8834519 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:51.270829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-acf16242-df39-420e-9487-ca54f8834519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:51.297200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.298459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.298887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.299301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] PATH_INFO: `/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.301016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] RBAC: Authorizing `identity:get_user(user_id=457693ad35ac49d99dc3c3ff79f1bd4d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.302530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.310597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 96/191] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/users/457693ad35ac49d99dc3c3ff79f1bd4d => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.310597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.352143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 96/192] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:51.357055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16242-df39-420e-9487-ca54f8834519 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.378124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.406716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.438278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9263-338b-4781-9b05-c01ee23b2d6f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.475610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.476337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.476614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.476882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.477899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:51.479029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16242-df39-420e-9487-ca54f8834519 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.479133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.480418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.489275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 97/193] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.490086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.515083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.515865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.516178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.516453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.517621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.519091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.520739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 97/194] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.521488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.596660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4476d58-075d-4a6a-92ba-9f10a8a0d4dd None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.613067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.632043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cada4e-f426-4649-a6ce-05107046126c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.635143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.635786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.636096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.636371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.647029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.666260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.667058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.667334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.667611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.677451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:51.686293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:51.687346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 98/195] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:51.688365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.710410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.712144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.786118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01ce0-b6bf-41e8-b041-03b02e9b97e1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.807895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 98/196] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:51.808756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.819188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.820081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.820370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.820645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.834370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.835819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.838045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 99/197] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.838791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.841225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.854645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:51.911254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612986bb-7fb3-4414-a17d-5ddf1541e6bc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.936348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465adb0c-0afc-4786-a10f-ba02be5d936b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:51.944950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.945610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.945891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.946166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.947387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.948882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.984052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 99/198] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:51 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:51.984267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:51.984267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:51.984478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:51.984560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:51.984560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:51.984560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:51.984560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:51.984560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:51.988108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 100/199] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:51.988108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.061247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.101211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.105345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81d91e-135d-456b-a8dd-1e50a8ce78d0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.109220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d68bb-9856-4a9c-ab6f-49bf62bfcf4d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.146782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.147429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.147711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.147991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.155299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.156216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.156506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.156787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.158536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.160121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.162089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 100/200] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:52.162610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.234530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.236107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.303673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a5af-ffae-4234-8655-bf939709d3d6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.315109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.354474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.355520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.355808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.356442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.357936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.360210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.362314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 101/201] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:52.366831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.369450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 101/202] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:52.370957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.406466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.478902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9dfca-3c6d-406f-9944-3fa17cda80c5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.479295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd1717-a6c4-4589-b97c-afeebeea09f0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.517656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.518320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.518599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.518869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.526408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.527453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.527940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.528456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.529511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, scope.project.id=8eeb955df355413dbbf55747b50d9a06, user.id=457693ad35ac49d99dc3c3ff79f1bd4d) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:52.530123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.531892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.538651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 102/203] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/role_assignments?user.id=457693ad35ac49d99dc3c3ff79f1bd4d&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:52.545435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.551266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.597913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.599142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.667714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.676852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e05b-f01c-428a-8586-5d61dcbc3209 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.723975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.725048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.725900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.726299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.728576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.730250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.732696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 103/204] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:52.738642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.780907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 102/205] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:14:52.786676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:52.856148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:52.869471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed86b-6963-453e-81bb-cee75ea143f8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.919761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b65f-bd7b-41f7-ad8d-4ce9d596db03 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:52.939896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.940990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.941276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.941552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.942401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=d0486b2699774548bb378bb1070acfc7) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:52.942711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.944527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.951667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 104/206] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/role_assignments?user.id=d0486b2699774548bb378bb1070acfc7&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:52.981533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:52.982383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:52.982663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:52.982993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:52.989093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:52.990634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaf179-fd1c-4872-b40e-d55135cae8c5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:52.992904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 103/207] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:53.000053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:53.045613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:53.133961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0688625-2f88-4155-bfcd-60b171f61f39 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:53.180268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:53.181328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:53.181815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:53.182311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:53.183350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=d0486b2699774548bb378bb1070acfc7) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:53.183888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:53.185619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcdee0-2ea8-4748-9e62-a468239c4525 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:53.192744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 105/208] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:52 2022] GET /identity/v3/role_assignments?user.id=d0486b2699774548bb378bb1070acfc7&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:54.365110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ee1a-6fbc-4f1b-ac8e-8883c9371102 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.365624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ee1a-6fbc-4f1b-ac8e-8883c9371102 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.365707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ee1a-6fbc-4f1b-ac8e-8883c9371102 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.367050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 104/209] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:54.373066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.373536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.373610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.390852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:54.392056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:54.419301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a327d6a-8eba-4569-9854-1121dc50882e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.419618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a327d6a-8eba-4569-9854-1121dc50882e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.419858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a327d6a-8eba-4569-9854-1121dc50882e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.421587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 105/210] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:54.427596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.427881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.428189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.445876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:54.447209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:54.471968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 106/211] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:54.500977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:54.536084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:54.544132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 106/212] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:54.565090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:54.633365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:54.645580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26d200-5ed5-4e31-b072-485c4ad84928 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:54.683551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:54.684399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.684689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.684942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.685537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d540-8182-404c-8582-fca4e603ff95 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:54.700550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:54.705648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:54.706566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:54.707345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:54.715477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:54.742450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:54.743325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.744305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.744684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.746629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:54.747856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:54.756910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 107/214] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:54.764376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:54.832604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:54.860661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79897-6890-4870-86b4-f1e9216876be None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:54.908261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e93b3e-5fa0-426e-98f3-022c230f63c1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:54.918477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:54.919860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.920320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.921141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.922344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:54.922801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:54.924657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:54.942838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 108/215] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:54.945012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:54.949927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:54.959907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:54.961043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:54.961503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:54.961959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:54.963246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:54.965743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8550c66-fe1e-4c09-9e37-446dc0cae9f1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:54.997832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 108/216] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:54 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:55.095892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3725ce-1d3f-4767-8d92-40d5c73c1567 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.143164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7803-ad61-4708-93ee-aa8093fe6e4d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.143553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7803-ad61-4708-93ee-aa8093fe6e4d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.143792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7803-ad61-4708-93ee-aa8093fe6e4d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.145531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 109/217] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:14:55.151866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.152188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.152471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.161328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.162592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.163130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.163635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] PATH_INFO: `/v3/users/5b21eb3aaa584ee3bade7a2937011a00` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.172345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:55.172535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:55.180862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] RBAC: Authorizing `identity:get_user(user_id=5b21eb3aaa584ee3bade7a2937011a00)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:55.182927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:55.185040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 109/218] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:54 2022] GET /identity/v3/users/5b21eb3aaa584ee3bade7a2937011a00 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:55.191396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.196892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:55.279134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 110/219] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:55.303393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.348175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0426be-7978-47ac-aeda-4b7e2ac7631d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.393738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.394744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.395029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.395380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.439217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b2b0-8cac-4860-adbd-654f3705874e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.465414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:55.479055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.480881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.481233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.481516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.486747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:55.488656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:55.491257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:55.494389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-28204aa3-6e97-44ee-8d89-7f7afe357bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:55.505340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:55.506237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:55.507442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 111/220] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:55.508125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde9a7-a578-4f7f-b154-8ea24b0df31a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.508406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde9a7-a578-4f7f-b154-8ea24b0df31a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.508556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde9a7-a578-4f7f-b154-8ea24b0df31a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.510111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 112/221] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:55.515622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.515911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.516217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.543206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:55.544935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:55.612135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 110/222] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:14:55.613569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.646571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 113/223] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:55.648137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.738837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c397-0b77-420b-ac04-4506f0eb85f7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.740598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:55.775422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375622-657d-4c61-8dc6-5f74062158e2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.775900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.776604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.776886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.777162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.777910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:55.778242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:55.779892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:55.786426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:55.792073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 111/224] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:55.793168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.828939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.829871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.830389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.830759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.833148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:55.834724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:55.836734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 114/225] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:55.838214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:55.913716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411f30-07f7-4d5c-9d01-0dfe146679d5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.952411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:55.953768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:55.954147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:55.954824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:55.959577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753daf6-0e9a-4cd6-a319-0aed59b43aeb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:55.970298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:55.982534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:55.983492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 112/226] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:55.988557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.007850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.009279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.010096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.010554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.011976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.014477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.016460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:56.016769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 115/227] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:56.017961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.072754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:56.106723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db59e-04d7-4f3e-adc1-6a9079e35103 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.133807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb6cb-8cf4-4ac6-88fe-9aa54c5660c8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.143138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.144104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.144590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.145075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.146094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=5b21eb3aaa584ee3bade7a2937011a00) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:56.146635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.148317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.154246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 113/228] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:55 2022] GET /identity/v3/role_assignments?user.id=5b21eb3aaa584ee3bade7a2937011a00&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:56.155245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.182719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.182719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.183035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.183270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.183975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:56.185167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.186834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.207916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 116/229] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:56.214562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.343962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:56.360744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84b76-0da8-4e39-9625-db8f7ee71b08 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.402230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.403784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.404262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.404554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.406355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.408410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.411485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 114/230] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:56 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:56.420972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.429395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60519-b93f-42a5-a9f7-eed925b54d4b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.444342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:56.488700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.490114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.493803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.494429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.497178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.498908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.502496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 117/231] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:56 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:56.523550 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.598671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf681-476c-4645-b37b-931b42b4c850 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.635685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.636955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.637437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.637908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/d0486b2699774548bb378bb1070acfc7/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.640149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, user_id=d0486b2699774548bb378bb1070acfc7, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.641831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.667912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 115/232] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:56 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/d0486b2699774548bb378bb1070acfc7/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:56.732608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f997-b95a-4a7a-8790-7d7d1e64e149 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.804812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.806717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.807165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.807597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:56.809706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:56.812388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c72e29-321b-4f49-86c7-2e9dd831d2ad None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:56.815299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 118/233] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:56 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:56.821156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:56.855911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:56.962097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca01a68-36c9-4e66-bd5c-fedecd64d22e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:56.997568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:56.998804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:56.999287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:56.999782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/d0486b2699774548bb378bb1070acfc7/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.002268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, user_id=d0486b2699774548bb378bb1070acfc7, role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:57.003958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93c4a4-53a5-441a-be2e-4cacfeebe432 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:57.023098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:14:56 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/d0486b2699774548bb378bb1070acfc7/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:14:57.533914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e820e-5d0a-4b81-8d51-5543b9719551 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:57.534608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e820e-5d0a-4b81-8d51-5543b9719551 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:57.534608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e820e-5d0a-4b81-8d51-5543b9719551 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.535813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 119/235] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:57.541797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542694e8-34e0-4f87-aa57-14e945f2b6d3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:57.542428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542694e8-34e0-4f87-aa57-14e945f2b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:57.542428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542694e8-34e0-4f87-aa57-14e945f2b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.559810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-542694e8-34e0-4f87-aa57-14e945f2b6d3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:57.561042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-542694e8-34e0-4f87-aa57-14e945f2b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:57.643594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 117/236] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:57.681071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e820e-5d0a-4b81-8d51-5543b9719551 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:57.763551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:57.863204 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e820e-5d0a-4b81-8d51-5543b9719551 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:57.918000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:57.919236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:57.919675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:57.920134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.931837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d190f1-a975-46a1-b0d0-d5a367d8b0ac None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:57.932306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d190f1-a975-46a1-b0d0-d5a367d8b0ac None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:57.932726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d190f1-a975-46a1-b0d0-d5a367d8b0ac None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.934946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 118/237] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:57.941107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:57.941543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:57.941962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:57.955896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:57.964371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:57.972392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:57.974777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:57.976784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 120/238] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:14:57.979161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:57.979161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:57.985518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.164512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:58.169801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a71c-95f2-40ba-8a1f-69e3bcd7241e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:58.173961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 119/239] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:58.208753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.228677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:58.228677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.228983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.229139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.229910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:58.230210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:58.231601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:58.248237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 121/240] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:58.262458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.334810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e2ec-6999-40a1-a6ba-08b4c5dec250 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:58.387801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:58.388689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.389009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.389345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.392447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:58.393919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:58.395568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 120/241] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:14:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:58.404955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.409022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:58.464390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfd73-28d8-4ccb-88aa-dda002caf2c1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:58.519195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:58.520589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.521027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.521446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] PATH_INFO: `/v3/users/8e9f915fae284270b3f1bce28d0dacd3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.545464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9f915fae284270b3f1bce28d0dacd3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:58.547844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:58.550603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 122/242] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:58 2022] GET /identity/v3/users/8e9f915fae284270b3f1bce28d0dacd3 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:58.557747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.597629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfdee-2fe5-4b07-8a38-35ef2bcdec8d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:58.599372 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:58.663638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:58.664339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.664621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.664886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.666167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:58.667738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14454ac4-8873-41fc-97a1-78f8dedb3a57 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:58.700368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bc8ad-a1e6-4bab-850b-c371c3a63134 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:58.712434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 121/243] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:14:58 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:14:58.714063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556e9c-d045-4e8b-a368-91429e08ed58 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.714487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556e9c-d045-4e8b-a368-91429e08ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.714790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556e9c-d045-4e8b-a368-91429e08ed58 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.716680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 122/244] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:58.737693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.739335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.740094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.752073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:58.752073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:58.752073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:58.752073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:58.789097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:58.790853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:58.829785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:58.831356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:58.857461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:58.931522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:58.951347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 123/245] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:14:58.958462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:14:58.965148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:58.977303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.099285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc30c-67e0-496e-8138-35d1c7d87950 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.119219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000f73-a38b-4c1f-8a0f-73ce61ed8eaf None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.148165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.149836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.150269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.150689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.152110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:59.153007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:59.154536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:59.158868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 124/247] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:58 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:59.164261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.181221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.183519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.184110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.184656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.200305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:59.210844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:59.211926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:14:59.213652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:14:59.216301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 124/248] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:59.231872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.272487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:59.334306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ac55b-74a7-4e5d-b476-25693ea1764f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.385283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.386644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.387071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.387741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.388753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=8e9f915fae284270b3f1bce28d0dacd3) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:59.389199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:59.389625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb19ab-95a3-45cb-9c16-90c55f938328 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.390979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba754fe6-0184-4c77-ad88-e5e2fed4a57e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:59.404438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 125/249] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/role_assignments?user.id=8e9f915fae284270b3f1bce28d0dacd3&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:59.404438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8795-713c-4caa-9bf3-b41c499c0a00 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.404438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8795-713c-4caa-9bf3-b41c499c0a00 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.404438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8795-713c-4caa-9bf3-b41c499c0a00 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.404438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 126/250] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:14:59.411566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.411851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.412154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.451796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:14:59.453049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:14:59.469926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.470537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.471088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.471378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.472244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:59.472554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:59.474716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:59.498384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 125/251] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:59.503693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.553195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 127/252] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:14:59.578876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.615808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:59.639673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:59.694922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098339a5-4271-4894-bcd5-b61b458e7cf6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.735324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.736101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.736381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.736657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.750399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:14:59.759436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:14:59.760384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:14:59.761937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 128/253] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:14:59.769377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.798879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f836d-6217-42f4-9895-777af78fe4fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.890495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa78b-bab3-4f22-a438-afcedb42a704 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:14:59.916420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:14:59.927723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.932059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.932059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.932059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] PATH_INFO: `/v3/users/5b21eb3aaa584ee3bade7a2937011a00` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.932701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:14:59.933575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] RBAC: Authorizing `identity:get_user(user_id=5b21eb3aaa584ee3bade7a2937011a00)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:59.934419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:14:59.936187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:59.936663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:14:59.937083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:14:59.937993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:14:59.939868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 126/254] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/users/5b21eb3aaa584ee3bade7a2937011a00 => generated 297 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:14:59.940374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:14:59.942040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:14:59.945489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:14:59.964352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 129/255] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:14:59.971154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:00.109242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeee0-0584-4cf0-9624-bf029c2c7a68 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.128137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:00.151985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22877f-db4a-4161-8431-f70ba8c34627 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.179001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:00.179876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.180189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.180470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.182424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:00.183898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d4fd-2159-41be-b58b-e2065a148d19 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:00.188622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 127/256] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:00.191247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1499cd-10f6-4c20-9b5f-829807e4677a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.191538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1499cd-10f6-4c20-9b5f-829807e4677a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.191820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1499cd-10f6-4c20-9b5f-829807e4677a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.199401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 128/257] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:00.200050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1499cd-10f6-4c20-9b5f-829807e4677a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:00.260098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:00.261419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.261951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.262442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.264942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:00.267958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569398b-752c-4051-ba10-7df4843da1b4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:00.280793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 130/258] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:14:59 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:00.282218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.282510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.282783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.321100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:00.322854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:00.383043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1499cd-10f6-4c20-9b5f-829807e4677a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.402416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:00.448875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:00.449886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.450165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.450441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/5b21eb3aaa584ee3bade7a2937011a00/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.453748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, user_id=5b21eb3aaa584ee3bade7a2937011a00, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:00.455227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:00.466675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 131/259] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:00.467713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:00.483637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 129/260] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:00 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/5b21eb3aaa584ee3bade7a2937011a00/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:00.506113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:00.592794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:00.696172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046059-0fab-45b0-88de-ca625f43fdf2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.719157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f079e-caa1-4866-8ec5-a3dea8c50eee None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.768098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:00.768762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.769051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.769306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.788260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:00.789425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:00.789899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:00.791007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:00.802730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:00.812838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:00.813743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:00.814705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:00.817488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 130/261] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:00.825643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:00.832499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:00.864206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:00.864625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:00.957572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a980-178e-43e2-88fa-953134f9d769 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:00.964325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:01.001025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 132/262] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:01.009449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:01.036135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:01.036814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.037096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.037370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.038182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:01.038489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:01.039936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:01.061945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 131/263] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:01.077759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:01.164441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:01.228046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf16336-9b6e-44a4-be73-74a13e30bbf4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:01.284840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198dfd7-31a0-4d97-8f97-796bd0c138f7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:01.329405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:01.330335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.330616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.330892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.332999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:01.334464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:01.337465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 133/264] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:01 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:01.342363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:01.363110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:01.363995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.364306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.364574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] PATH_INFO: `/v3/users/d0486b2699774548bb378bb1070acfc7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.365816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] RBAC: Authorizing `identity:get_user(user_id=d0486b2699774548bb378bb1070acfc7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:01.367280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:01.372535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 132/265] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:01 2022] GET /identity/v3/users/d0486b2699774548bb378bb1070acfc7 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:01.381135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:01.462798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:01.591802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c8952-c0be-446a-8d2d-17f899dbc0ee None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:01.620350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207b46e-6783-4f0f-98a6-7b545ccb325f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:01.684830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:01.685847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.686402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.686867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.687882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=d0486b2699774548bb378bb1070acfc7) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:01.688377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:01.690318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855cbd3-3f5b-4733-a6fa-909abdbf947c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:01.697288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:01.697956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.698241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.698519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.700664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 134/266] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:01 2022] GET /identity/v3/role_assignments?user.id=d0486b2699774548bb378bb1070acfc7&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:01.891041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754b74-c6a5-46cd-a6f2-9eb394418ee0 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.891612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754b74-c6a5-46cd-a6f2-9eb394418ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.892096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6754b74-c6a5-46cd-a6f2-9eb394418ee0 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.893685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 135/267] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:01.900088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:01.900088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:01.905026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:01.905625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:01.906099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:01.926890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:01.949170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:01.950726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:01.956454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.068410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 133/268] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:02.077655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.139973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:02.175156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.202942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31829f4-86f9-4eba-b14d-a2ad6219a9cb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.236083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.248659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.249865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.251520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.252124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.253914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:02.257246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:02.260963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 134/270] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:02.267826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.363532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f614c2-6135-4ae4-9644-df9db4947a31 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.404231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51e59-f878-4a8f-81df-ed3c67f71655 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.412057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.413154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.413674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.414295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.417806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.429890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:02.442043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:02.442961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:02.443740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:02.446807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 137/271] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:02.454969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.454969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.454969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.454969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.455551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=d0486b2699774548bb378bb1070acfc7) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:02.455842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:02.456933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.457336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983e46-422c-4ccd-b5eb-cbc1b3e30886 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:02.475801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 135/272] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/role_assignments?user.id=d0486b2699774548bb378bb1070acfc7&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:02.513951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c21cc7-b5ee-43b1-aed2-6cbc6c5b0b30 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.514620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c21cc7-b5ee-43b1-aed2-6cbc6c5b0b30 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.515105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c21cc7-b5ee-43b1-aed2-6cbc6c5b0b30 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.516945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 136/273] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:02.533609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029894e7-0b5e-4998-93d7-2158f6a664d7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.534254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029894e7-0b5e-4998-93d7-2158f6a664d7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.534972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029894e7-0b5e-4998-93d7-2158f6a664d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.555034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-029894e7-0b5e-4998-93d7-2158f6a664d7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:02.556751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-029894e7-0b5e-4998-93d7-2158f6a664d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:02.618989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722d809-db38-4d2e-b29a-8ba087042251 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.641194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.657839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 137/274] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:02.659552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9fa60-3248-4237-88ae-d85163e68a4c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.659849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9fa60-3248-4237-88ae-d85163e68a4c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.660151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9fa60-3248-4237-88ae-d85163e68a4c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.661567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 138/275] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:02.667383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.667792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.668351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.670644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.671473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.671975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.672488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.673419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:02.673863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:02.675737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:02.685990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 138/276] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:02.689156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:02.690685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:02.690801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.771191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.781766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 139/277] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:02.781766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.828344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626cfd-a524-4595-b581-fa1f1aab12fc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.869944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.871060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.871537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.871817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.873078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:02.874546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:02.876447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 139/278] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:02.877147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:02.911230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80377-41e8-4183-897b-682f3df4670f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:02.939611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:02.954102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:02.955157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:02.955493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:02.955790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] PATH_INFO: `/v3/users/5d2a0e16a06e41939683b1d66c1cade6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:02.971544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] RBAC: Authorizing `identity:get_user(user_id=5d2a0e16a06e41939683b1d66c1cade6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:02.973223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:02.975240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 140/279] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/users/5d2a0e16a06e41939683b1d66c1cade6 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:02.975907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.003564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c766-5c38-458b-8a3e-a0287b79f123 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.039245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.052643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.053725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.054015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.054299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.068010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:03.077024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:03.077915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:03.078756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 140/280] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:03.079407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.102780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c14d8-4356-4d68-ae01-e8af1985576a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.143174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.143933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.144220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.144496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.145208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.146938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.175470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 141/281] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:02 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:03.176703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.203634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7394-9e13-4e45-a6cc-c5dca0369394 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.223785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.263025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.264265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.264756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.265261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.266351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, user.id=5d2a0e16a06e41939683b1d66c1cade6, scope.system=all) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:03.266887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.268893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40add-96e8-4445-88cb-1d3805af9298 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.275953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 141/282] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/role_assignments?user.id=5d2a0e16a06e41939683b1d66c1cade6&scope.system=all&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:03.309054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52151a2-bc3f-4bfc-a4d0-52c3c07e6dee None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.309411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52151a2-bc3f-4bfc-a4d0-52c3c07e6dee None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.309619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52151a2-bc3f-4bfc-a4d0-52c3c07e6dee None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.311244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 142/283] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:03.315585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acabff-f928-42de-a7d8-2e160557732b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.317117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.317409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.317691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.336667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:03.338565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:03.358479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.359166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.359446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.359719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.360543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:03.360848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.363069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.377562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 142/284] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:03.383512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.407350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.443413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 143/285] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:03.467438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.517582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.525446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c810c-ebbd-4cbf-808f-1b56770984e7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.572069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.572421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.572709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.573271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] PATH_INFO: `/v3/users/8e9f915fae284270b3f1bce28d0dacd3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.575065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9f915fae284270b3f1bce28d0dacd3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.576591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.579094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 143/286] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/users/8e9f915fae284270b3f1bce28d0dacd3 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:03.584552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.604329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758072-2fa9-4f0e-b863-7b886ddeeee1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.642276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.643092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.643377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.643654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.656132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:03.663878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:03.664909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:03.666217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 144/287] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:03.671993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.721362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee726d-cd5a-41a9-a6e3-37384a8acda4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.728822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.770594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.771623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.771913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.772253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.773439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.775736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.779009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 144/288] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:03.785236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.813506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3f45-ec57-4d8e-aba1-5214d04b9ad2 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:03.823022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:03.853068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:03.853797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:03.854086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:03.854392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:03.855285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:03.855594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:03.857100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:03.866758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 145/289] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:03.873108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:03.960672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52bed4-7bbc-43af-a5e5-8bc5e152f8e2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:04.016863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c792-3637-4dde-8d31-bf3167c3a4a0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:04.020355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:04.041140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:04.042033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:04.042313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:04.042588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/8e9f915fae284270b3f1bce28d0dacd3/roles/cef9b5cb13244b31b74508092d6b1fd3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:04.046240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, user_id=8e9f915fae284270b3f1bce28d0dacd3, role_id=cef9b5cb13244b31b74508092d6b1fd3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:04.047735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:04.071082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 145/290] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:03 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/users/8e9f915fae284270b3f1bce28d0dacd3/roles/cef9b5cb13244b31b74508092d6b1fd3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:04.088879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:04.089833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:04.090164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:04.090462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] PATH_INFO: `/v3/users/5b21eb3aaa584ee3bade7a2937011a00` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:04.091956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b21eb3aaa584ee3bade7a2937011a00)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:04.093477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:04.095253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 146/291] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:03 2022] GET /identity/v3/users/5b21eb3aaa584ee3bade7a2937011a00 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:04.101104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:04.256788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:04.275056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aae2b-4b28-4293-b559-2e23630e4acb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:04.324660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:04.325322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:04.325600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:04.325874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:04.402806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:04.404331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:04.524101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:04.536924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 146/292] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:04.543360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:04.691788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd9fc-4631-4ab1-95fb-400893fc08f0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:04.742971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:04.744430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:04.744712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:04.744985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:04.746266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:04.747718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcaab1-54ef-477a-a569-52406f9afffa None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:04.750787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 147/293] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:04 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:04.757143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:04.913010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1b4d-0c27-4c45-9aa5-1fd4dd7ddf22 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:04.959693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:04.960386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:04.960663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:04.960935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:04.961805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=5b21eb3aaa584ee3bade7a2937011a00) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:04.962114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:04.963549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2674-e227-42f5-a695-972c0ed24a16 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:04.976186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 147/294] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:04 2022] GET /identity/v3/role_assignments?user.id=5b21eb3aaa584ee3bade7a2937011a00&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:05.541277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaccb0-8fea-48c5-9e8e-0a5ec941af58 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:05.541822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaccb0-8fea-48c5-9e8e-0a5ec941af58 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:05.541822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaccb0-8fea-48c5-9e8e-0a5ec941af58 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:05.543356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 148/295] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:05.549289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:05.549579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:05.549859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:05.576588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:05.577803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:05.644311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:05.668248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 148/296] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:05.691376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaccb0-8fea-48c5-9e8e-0a5ec941af58 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:05.733872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:05.802052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaccb0-8fea-48c5-9e8e-0a5ec941af58 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:05.835890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:05.837277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:05.837559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:05.837828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:05.848281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f49ff668-03da-469c-a8ef-2cad6c3e5c7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:05.856839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:05.857722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:05.858527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 149/297] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:05.865289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:05.881459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70493f-131a-4345-a2e0-2c5d8d5f3e19 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:05.882063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70493f-131a-4345-a2e0-2c5d8d5f3e19 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:05.882563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70493f-131a-4345-a2e0-2c5d8d5f3e19 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:05.884654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 150/298] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:05.890432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:05.890718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:05.890997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:05.911271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:05.912504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:05.979168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7091b45-ae63-4798-a062-fa91cd434e2c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.008206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 151/299] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:06.025838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.026515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.026802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.027143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.027959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:06.028306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.029742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.034197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.038977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 149/300] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:06.044898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.068623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.110505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.176088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15725-1fa4-4b5f-9df2-c04344b2c2a0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.178278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b2e2-f758-4a53-aab5-6b20f803e6ef None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.229271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.230642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.231142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.231563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] PATH_INFO: `/v3/users/5d2a0e16a06e41939683b1d66c1cade6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.231698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.232583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.232967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.233338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.233656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] RBAC: Authorizing `identity:get_user(user_id=5d2a0e16a06e41939683b1d66c1cade6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.235504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.237392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 150/301] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/users/5d2a0e16a06e41939683b1d66c1cade6 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:06.243625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.252679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:06.264822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:06.265732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:06.266535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:06.271250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 152/302] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:06.272788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.361967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc858e7-ac1c-482e-97ea-c94f90e2ee1f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.378371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.397033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.397893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.398179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.398459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] PATH_INFO: `/v3/system/users/5d2a0e16a06e41939683b1d66c1cade6/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.400527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5d2a0e16a06e41939683b1d66c1cade6, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.401936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf96da9-1891-4c4b-9323-56d333be0525 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.404395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.411725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 151/303] 10.222.0.13 () {58 vars in 1334 bytes} [Fri Jun 24 14:15:06 2022] PUT /identity/v3/system/users/5d2a0e16a06e41939683b1d66c1cade6/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:15:06.421654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21a61b-c05e-4240-9e4e-b13c642e69bf None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.421959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21a61b-c05e-4240-9e4e-b13c642e69bf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.422229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21a61b-c05e-4240-9e4e-b13c642e69bf None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.423628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 152/304] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:06.429456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.429743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.430026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.435259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc8fa-c96d-42cc-8ca3-272d3cf14a11 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.459534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:06.461277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:06.497498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.498410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.498804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.499183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.500462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:06.500885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.503366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.517234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 153/305] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:06.522729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.559365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 153/306] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:06.587013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.642567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93317a1a-124d-4f03-883f-e5011745ef15 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.679400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.680986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.681359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.681763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] PATH_INFO: `/v3/users/9b1600debebf44378e3b7f1b04d67ab6` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.697799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1600debebf44378e3b7f1b04d67ab6)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.699268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0b31-27c9-4c0e-ab45-8d583bb119d5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.701006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 154/307] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/users/9b1600debebf44378e3b7f1b04d67ab6 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:06.701709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd3da-ca3f-4965-a74e-6764c93f359a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.702238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbebe-9d2b-4385-9358-d21dc83352e3 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.702519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbebe-9d2b-4385-9358-d21dc83352e3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.702793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbebe-9d2b-4385-9358-d21dc83352e3 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.704053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 155/308] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:06.706520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbebe-9d2b-4385-9358-d21dc83352e3 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.716050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.719486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.747530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.748458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.748739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.749013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.750187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.751643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69a9d7-2434-4e35-9122-d6032e98b78d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.757774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 154/309] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:06.757774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.757774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.757774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.772035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:06.773227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:06.821034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbebe-9d2b-4385-9358-d21dc83352e3 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.856041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 155/310] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:06.856041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.859567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:06.860245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:06.860532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:06.860790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:06.861625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, user.id=9b1600debebf44378e3b7f1b04d67ab6, scope.system=all) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:06.861937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:06.863498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:06.869750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 156/311] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/role_assignments?user.id=9b1600debebf44378e3b7f1b04d67ab6&scope.system=all&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:06.874499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:06.975305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bab009-5ae0-4934-a8f8-b0270524c827 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:06.978013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:06.989760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:07.024313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031fabc-7f89-4794-8a2f-6e26742bb922 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:07.029395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.030148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.030496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.030777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] PATH_INFO: `/v3/groups` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.031469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:07.033005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:07.053239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 156/312] 10.222.0.13 () {60 vars in 1134 bytes} [Fri Jun 24 14:15:06 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:07.071136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.072402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.072959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.073442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.089928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:07.099745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:07.100781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:07.101543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:07.104961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:07.111174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:07.246434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652578-4fa1-4543-b0a8-bca52587df7e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:07.291447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.292152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.292494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.292775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.293536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:07.293842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:07.295237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:07.304655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 157/314] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:07.310565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:07.421583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ef37d-5851-4de7-9d08-b32b4386202a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:07.453032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:07.459734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.460982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.461549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.462035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] PATH_INFO: `/v3/users/8e9f915fae284270b3f1bce28d0dacd3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.463553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9f915fae284270b3f1bce28d0dacd3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:07.465256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:07.467474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 158/315] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:07 2022] GET /identity/v3/users/8e9f915fae284270b3f1bce28d0dacd3 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:07.472587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:07.517409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:07.592269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a305b5-733e-412e-8a41-348636f0e352 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:07.630348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.631378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.631885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.632392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.707968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:07.709471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:07.739148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:07.815825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:07.821553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:07.928328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a874-1cf8-4b21-afef-bcca738a0903 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:07.966722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:07.967785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:07.968270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:07.968687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:07.970017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:07.971616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4f81-e4a7-4662-a365-71689231d560 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:07.973794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 159/317] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:07 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:07.984042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:08.090871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c4f5-33f7-4c22-b8e7-100ba10c93f4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:08.128489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:08.129874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:08.130638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:08.130918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:08.131244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:08.132310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, scope.project.id=a93c1476c37a47d6b9fc87a62e562033, user.id=8e9f915fae284270b3f1bce28d0dacd3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:08.132682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:08.134485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ca08-f575-4fce-933b-9802cfcd8efd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:08.141514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 159/318] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:07 2022] GET /identity/v3/role_assignments?user.id=8e9f915fae284270b3f1bce28d0dacd3&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:08.619988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bd66-fd47-45d4-b058-0f6421b20377 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:08.620406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bd66-fd47-45d4-b058-0f6421b20377 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:08.620584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bd66-fd47-45d4-b058-0f6421b20377 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:08.622089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 160/319] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:08.626986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:08.627271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:08.627549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:08.644739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:08.645915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:08.722316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:08.746313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3bd66-fd47-45d4-b058-0f6421b20377 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:08.815890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:08.852925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3bd66-fd47-45d4-b058-0f6421b20377 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:08.887911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:08.888645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:08.888925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:08.889198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:08.899885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5dad0b8b-adda-43ce-a836-707f0b155212 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:08.907570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:08.908674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:08.909479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 161/321] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:08.914463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.009723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ad0b-7eb6-467e-9ba6-e26a89cd363d None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.010005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ad0b-7eb6-467e-9ba6-e26a89cd363d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.010382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ad0b-7eb6-467e-9ba6-e26a89cd363d None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.011755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 162/322] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:09.016270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d04ad-e102-47b4-b565-2d08b26ba5d6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.017100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.017380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.017659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.035254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:09.036467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:09.041176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.056741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.057403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.057683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.057956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.058705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:09.059008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.060417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.068603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 161/323] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.073937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.114300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:09.137101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.181175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc1b5-04af-4c89-b82f-2809d025446d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.201582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.221010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.222132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.223359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.223647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] PATH_INFO: `/v3/users/5d2a0e16a06e41939683b1d66c1cade6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.224919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=5d2a0e16a06e41939683b1d66c1cade6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.226383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.229537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 162/325] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/users/5d2a0e16a06e41939683b1d66c1cade6 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.234963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.254087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eefb96-19b3-4f84-adf1-0528fa181221 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.288164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.288953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.289233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.290041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.290424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.300774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-dd2e7ef7-9ea0-45eb-bf13-fe96f0bccc7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:09.309147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:09.310033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:09.310832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 164/326] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:09.311899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466926-1099-483c-b980-f5c5cd42768f None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.312203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466926-1099-483c-b980-f5c5cd42768f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.312482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466926-1099-483c-b980-f5c5cd42768f None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.313740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 165/327] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:09.316358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466926-1099-483c-b980-f5c5cd42768f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.337159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067715a-7f2d-40d6-9ea2-0d91f66e8cd8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.373730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.374370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.374646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.374912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.375735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] RBAC: Adding query filter params (role.id=2bfcd0e9346b4c9cb796e54313815a05, user.id=5d2a0e16a06e41939683b1d66c1cade6, scope.system=all) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:09.376052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.377479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61636b3d-00c1-43b5-8348-a6110d440c03 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.388655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 163/328] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/role_assignments?user.id=5d2a0e16a06e41939683b1d66c1cade6&scope.system=all&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.393489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.393892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.394175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.412843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:09.414207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:09.422670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466926-1099-483c-b980-f5c5cd42768f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.440668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.462334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.463123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.463472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.463812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.464662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:09.465030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.466505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.478215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 166/329] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.485313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.494093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 164/330] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:09.518929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.572119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.610133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1fdba-ee59-4a15-a7c1-988507ff1dec None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.634904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4ded2-98c9-4589-8213-1ccc74b061db None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.643727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.644618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.644903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.645170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] PATH_INFO: `/v3/users/9b1600debebf44378e3b7f1b04d67ab6` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.646340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1600debebf44378e3b7f1b04d67ab6)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.647771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.649635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 167/331] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/users/9b1600debebf44378e3b7f1b04d67ab6 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.654915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.667411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.668218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.668495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.668764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.669892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.671349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.673105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 165/332] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:09.678244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:09.704238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.756982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a48a21-3b3e-46a1-80b1-109a19419b21 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.792743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.793590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.793865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.794133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] PATH_INFO: `/v3/system/users/9b1600debebf44378e3b7f1b04d67ab6/roles/cef9b5cb13244b31b74508092d6b1fd3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.794971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c544-141e-4230-bb5f-a6ae1fa9b7e9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:09.795593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b1600debebf44378e3b7f1b04d67ab6, role_id=cef9b5cb13244b31b74508092d6b1fd3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.797026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6a12f-39b6-42c1-b97c-8dec24c65129 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.805647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 168/333] 10.222.0.13 () {58 vars in 1334 bytes} [Fri Jun 24 14:15:09 2022] PUT /identity/v3/system/users/9b1600debebf44378e3b7f1b04d67ab6/roles/cef9b5cb13244b31b74508092d6b1fd3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:15:09.806046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:09.841155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:09.841832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:09.842110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:09.842379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] PATH_INFO: `/v3/groups` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:09.843090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:09.844659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f890e45-4626-4ee2-b37f-f2774fc5d231 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:09.860092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 166/334] 10.222.0.13 () {60 vars in 1134 bytes} [Fri Jun 24 14:15:09 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:15:12.386462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469053a7-3995-44e0-a71c-6565c23c1e6c None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.387345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469053a7-3995-44e0-a71c-6565c23c1e6c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.387764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469053a7-3995-44e0-a71c-6565c23c1e6c None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.389548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 169/335] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:12.395106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.395839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.396313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.404094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099366fa-d807-4e33-a7e2-7ebe71c1f800 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.404598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099366fa-d807-4e33-a7e2-7ebe71c1f800 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.405017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099366fa-d807-4e33-a7e2-7ebe71c1f800 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.407474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 170/336] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:12.420131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.420632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.421055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.436307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:12.437849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:12.446675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:12.452352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:12.602955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 167/337] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:12.618819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 171/338] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:12.659548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:12.668901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:12.769493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:12.868722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:12.872346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44c7c-adc5-4037-bc4a-514a05bba2f5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:12.907353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c169-39a8-4957-a505-756e107ffd39 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:12.917397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:12.918302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.918583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.918852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.931067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ef8be72f-a98b-4c01-8355-bef141fa25cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:12.939571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:12.940659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:12.941558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:12.944288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 168/339] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:12.946293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:12.946584 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28de6-eadd-4b7d-ad9f-dc9228191db3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.947011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28de6-eadd-4b7d-ad9f-dc9228191db3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.947138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.947364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.947638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.947815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28de6-eadd-4b7d-ad9f-dc9228191db3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.953757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 169/340] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:12.954804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f80d-1bed-4408-8591-1fcacd24a6a8 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.955090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f80d-1bed-4408-8591-1fcacd24a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.955366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f80d-1bed-4408-8591-1fcacd24a6a8 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:12.960295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 170/341] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:12.961084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f80d-1bed-4408-8591-1fcacd24a6a8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:12.968507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-e016e30f-481a-4f10-82c0-c03c5fd0ef35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:12.978073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:12.978949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:12.979717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:12.982242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 172/342] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:12.983662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0240e1-f6ce-4702-9ed0-17b35289e36d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:12.984751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0240e1-f6ce-4702-9ed0-17b35289e36d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:12.985250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0240e1-f6ce-4702-9ed0-17b35289e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.002823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4c0240e1-f6ce-4702-9ed0-17b35289e36d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:13.004355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4c0240e1-f6ce-4702-9ed0-17b35289e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:13.079187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 173/343] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:13.081051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.081566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.082086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.088682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f80d-1bed-4408-8591-1fcacd24a6a8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.101223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:13.103072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:13.128684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.141205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.141836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.142121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.142401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.143158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:13.143465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:13.144882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:13.154887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 171/344] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:13.155708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.185488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.195656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 174/345] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:13.196691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.321695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af3a8-2545-4107-ac0e-1d5b08873dc1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.324979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632cb15-a0f6-48e4-8ea8-d070dd1431f0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.374172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.374953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.375229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.375500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.386080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.386676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.386950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.387219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.387969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:13.388289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:13.389695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:13.398212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:13.405146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 172/346] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:13.407661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:13.408569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:13.409457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:13.410344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 175/347] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:13.411017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.444241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.517594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.535384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91778e0-5cd8-44e3-a3fc-4bcfe89919a4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.550277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9da21-0f86-4d60-8161-b20b39f82c29 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.572454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.573597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.574074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.574539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.590568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.591710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.592253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.592745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.608366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:13.618750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:13.619661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:15:13.620832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:13.623249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 176/348] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:13.624266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.649735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:13.651203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:13.722900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.742198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.749508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0bad-4ee0-4b6b-8511-fba629d0baae None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.762560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 173/349] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:13.763688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.790861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.791660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.792074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.792554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.869668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfcca6-4c3c-4fed-b195-441bb7321fff None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:13.886379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:13.888159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:13.908445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:13.909366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:13.909792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:13.910203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:13.911120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:13.911593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:13.913305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:13.923003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 174/350] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:13.924159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:13.979391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:13.990237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.014437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 177/351] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:14.015728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.043942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579f219-619c-4657-a7a8-ab0fda33d3a5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.091007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.091680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.092135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.092412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.093173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:14.093475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.094945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.103856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 175/352] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.107338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.150249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395fcca-8850-4002-b838-98c05e285dd5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.192343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.193244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.193519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.193804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.195054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.196709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.198425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 178/353] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.199197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.249983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95b66-c3ed-48c0-8dae-3f1deab8b095 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.260059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.261908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.297772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.300896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.301252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.301597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.339983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75caf11-f42d-4159-8d88-69bf9ab23abb None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.393285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.394154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.394438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.394732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.395910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.397519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12f47d-d95b-4a10-b46f-777615a31020 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.399790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 179/354] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.401722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ff26-cb1e-4c4a-9002-8330e83c991c None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.401722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ff26-cb1e-4c4a-9002-8330e83c991c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.405232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ff26-cb1e-4c4a-9002-8330e83c991c None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.406464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.408088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 180/355] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:14.409055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.409195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42ff26-cb1e-4c4a-9002-8330e83c991c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.556560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 176/356] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:14.557782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.563224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42ff26-cb1e-4c4a-9002-8330e83c991c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.568128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.586108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.612822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.613754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.614048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.614306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] PATH_INFO: `/v3/users/9b1600debebf44378e3b7f1b04d67ab6` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.615601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1600debebf44378e3b7f1b04d67ab6)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.617155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.619412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 181/357] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/users/9b1600debebf44378e3b7f1b04d67ab6 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.624351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.684809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8b1e-4a34-4009-b3a6-a93decbd2ce3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.725460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.726319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.726603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.727670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.735988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.737764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e4f1-f081-40a8-b5ed-62f0dacd8f13 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.739605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 177/358] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.741168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739319-50f2-4830-8fcf-1231c72c18cd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.741168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739319-50f2-4830-8fcf-1231c72c18cd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.741448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739319-50f2-4830-8fcf-1231c72c18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.762420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9b739319-50f2-4830-8fcf-1231c72c18cd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:14.762924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9b739319-50f2-4830-8fcf-1231c72c18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:14.766175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c3931-dd6a-4bbb-8ab4-391cef06e047 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.811219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:14.812059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.812469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.812730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.814913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:14.816661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:14.818563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 182/359] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:14.819952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.846757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 178/360] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:14.847992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa026ae8-239b-48cd-a3f6-3f017330afcb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:14.848420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa026ae8-239b-48cd-a3f6-3f017330afcb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:14.848687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa026ae8-239b-48cd-a3f6-3f017330afcb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:14.851131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 179/361] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:14.851131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa026ae8-239b-48cd-a3f6-3f017330afcb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:14.854701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.885023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:14.946928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf758545-ddad-4913-860e-c70d56f54019 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:14.986071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa026ae8-239b-48cd-a3f6-3f017330afcb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.000280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.001865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.001865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.001865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.002894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.005341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.006087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 183/362] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.006851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.034298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.035067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.035343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.035613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.038050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] RBAC: Adding query filter params (role.id=cef9b5cb13244b31b74508092d6b1fd3, user.id=9b1600debebf44378e3b7f1b04d67ab6, scope.system=all) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:15.038050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.038467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.052069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 180/363] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Jun 24 14:15:14 2022] GET /identity/v3/role_assignments?user.id=9b1600debebf44378e3b7f1b04d67ab6&scope.system=all&role.id=cef9b5cb13244b31b74508092d6b1fd3 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.052827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.142304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8f48-1861-4d8e-9ca6-5a2d4398944a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.156615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.168289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.188012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.188856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.189533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.189533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.190979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=8eeb955df355413dbbf55747b50d9a06) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:15.191297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.193440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e4718-8e16-426c-924b-a8f9622c3f29 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.202494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 184/364] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.204091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.204454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.204874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.228537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdbe59-398e-4901-af91-d3b11f70711c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.241705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:15.243519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:15.316847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.317935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.318218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.318492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.319336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=8eeb955df355413dbbf55747b50d9a06) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:15.319648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.321752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.328451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 181/365] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.331624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.337785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 185/366] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:15.340973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.471793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b28e-0a72-442a-aacb-4582395ab642 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.504976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27039dcd-5ca1-4322-8886-86e0a9724897 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.515626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.530467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.531285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.531566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.531840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.532291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.545445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:15.550570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.551437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.551715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.551991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.553246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:15.554752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:15.555811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:15.556676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:15.557330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.557400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 182/367] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:15.557464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 186/368] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.557537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.563257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.691697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a559dc3-b8e5-48f1-bb68-d231ec4339e0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.696903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218479dd-0df1-4c6d-9286-73a5dd42d7a6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.743278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.743610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.743861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.744106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.744279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.744428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.744583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.744733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.745277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:15.745763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.747290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.761695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 187/369] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.762548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.763233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:15.772946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:15.775659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 183/370] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:15.777118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:15.839742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.861339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:15.909510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f4eaa-607d-49f0-877d-ce4b6a25823d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.958086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:15.959282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:15.959683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:15.959960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:15.961157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=a93c1476c37a47d6b9fc87a62e562033) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:15.961475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:15.963630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:15.965252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d79fe-9d67-4af8-b083-4d9087e434fc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:15.973232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 188/371] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:15.974062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.019784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.020469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.020750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.021023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.105717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.107187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.161819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbe26-c66e-4438-b678-5ead8d4bb4cf None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.162939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.174294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.206725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.207421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.207702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.207976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.208787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:16.209093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.210512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.228798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 189/372] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:16.231656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.234346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 184/373] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:16.243641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.388507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549d67-153c-4502-a41c-5853e4888ace None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.399423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54fb4-9c01-4f9c-9568-a64f0f52bfd2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.441341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.442462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.442743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.443458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.444960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.446818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.448573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 185/374] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:16.458847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.463557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.464680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.465173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.465670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.489937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.543432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.601430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.603236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.653106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e592a-d0c9-4358-92f2-cd13b0ba3fe9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.725343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.726324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.726609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.727215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.729525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.731019 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.733129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 186/375] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:16.740769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.802846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 190/376] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:16.809622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:16.872226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.894918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:16.904326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc4e2-08ca-4f2a-8049-c02a86984445 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.937475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59a5b1-f7ed-4cd4-96ee-ac7de6dfb6be None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:16.946229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.946889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.947174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.947440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.948341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=a93c1476c37a47d6b9fc87a62e562033) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:16.948650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.950103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.957344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 187/377] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:16.982712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:16.983660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:16.983971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:16.984289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] PATH_INFO: `/v3/projects/ece624c61ff74175ac0fde255f3115b8` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:16.985886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] RBAC: Authorizing `identity:get_project(project_id=ece624c61ff74175ac0fde255f3115b8)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:16.987391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:16.989700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 191/378] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/projects/ece624c61ff74175ac0fde255f3115b8 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:16.996378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:17.138312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a602e4-54ee-4a45-a7f9-286a1c540b8b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:17.185940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:17.186784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.187073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.187345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] PATH_INFO: `/v3/groups/2e0afb372f5044b0b0690015ed1e4664` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.192978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] RBAC: Authorizing `identity:get_group(group_id=2e0afb372f5044b0b0690015ed1e4664)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:17.194441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1562-dd0f-4be5-86e1-af34610a78d4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:17.196714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 188/379] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:16 2022] GET /identity/v3/groups/2e0afb372f5044b0b0690015ed1e4664 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:17.203102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:17.339576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25643e-5941-4e9c-86d0-5eff18ff9c51 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:17.375990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:17.376676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.376954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.377226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.378057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] RBAC: Adding query filter params (group.id=2e0afb372f5044b0b0690015ed1e4664, role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=ece624c61ff74175ac0fde255f3115b8) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:17.378541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:17.379998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626deb2f-ecfe-4c14-b412-45cbacc31ad2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:17.386892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 192/380] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:17 2022] GET /identity/v3/role_assignments?group.id=2e0afb372f5044b0b0690015ed1e4664&scope.project.id=ece624c61ff74175ac0fde255f3115b8&role.id=2f3ba2869328424982c43c608f72cb4e => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:17.928545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b92dc-a785-45dc-a806-91440505aa48 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.929064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b92dc-a785-45dc-a806-91440505aa48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.929064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b92dc-a785-45dc-a806-91440505aa48 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.931227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 189/381] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:17.936677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.937092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.937230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.942636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b145-6d0f-4f2b-8dee-f6eb11291f7b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.942921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b145-6d0f-4f2b-8dee-f6eb11291f7b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.943201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b145-6d0f-4f2b-8dee-f6eb11291f7b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.944854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 190/382] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:17.947262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:17.953520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:17.953808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:17.954088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:17.976062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:17.978164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:17.984112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:17.985278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:17.987728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:18.102535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 193/383] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:18.122437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 191/384] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:18.127936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.209635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.281569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a72c3-3880-47dc-96e8-5c7928d41a77 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:18.340398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:18.347729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:18.348697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.348979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.349246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.372627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:18.387403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:18.388505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:18.389308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 194/385] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:18.400967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.421257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f253-324d-45ee-b050-dcafd047e6a1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:18.500103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:18.501271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.502795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.503073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.518739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:18.531237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:18.550840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:18.551823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:18.552674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 192/386] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:18.561039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.588396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbf4e-0157-4034-b2a9-1e4ee9d0008f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:18.650889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:18.651982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.652512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.654499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.655580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:18.657114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:18.658773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:18.675007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 195/387] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:18.683322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.809635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:18.819843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb758-47c5-4d7f-8eeb-edef10cd1af2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:18.898585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:18.899452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.901589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.901979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.903085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:18.905127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31e4d-af16-4724-a848-8764263f7574 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:18.905636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:18.907199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903dca-2e0d-4564-a148-554c1c38dcd7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:18.924669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 193/388] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:18.926434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1a56-a640-4da8-82b4-e93447847c37 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.926722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1a56-a640-4da8-82b4-e93447847c37 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.927001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1a56-a640-4da8-82b4-e93447847c37 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.928385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 194/389] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:18.935442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1a56-a640-4da8-82b4-e93447847c37 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:18.962824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:18.963683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.963964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.964344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.965669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:18.967235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd585-ddc7-43e4-9bfb-84251afe0e37 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:18.969286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 196/390] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:18.970542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:18.970824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:18.971143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:18.989584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:18.990827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:19.018833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.068382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 197/391] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:19.069249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.070155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1a56-a640-4da8-82b4-e93447847c37 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.108932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.110799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.111160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.111517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.112861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.114534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.116421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 195/392] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:18 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:19.117308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.138903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.195165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee35a5-a3f1-4cad-a97f-6021c8443dd9 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.237553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.238839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.239301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.239808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.241451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.244161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.246390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 198/393] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:19 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:19.247415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.267063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15364f-8ce8-4fb9-a6f0-d7d634e37a6f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.299969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.310818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.311826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.312144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.312428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.326344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:19.335936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:19.337425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 196/394] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:19.339516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.410804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38529c-f657-4c80-b588-bb8a6727a284 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.443937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.469341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.471199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.472003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.472697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.472803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d20-0b0c-4891-9f02-b13182fec5bd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.475289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.478756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.482087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 199/395] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:19 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:19.483859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.513262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.514153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.514440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.514717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.516845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, group_id=f99091643e9b488aa9081dd7bbdfa36c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.518296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995ee4-f293-40fd-8f79-560e35a510b8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.535525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 197/396] 10.222.0.13 () {58 vars in 1442 bytes} [Fri Jun 24 14:15:19 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:19.537261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e19e1-b809-4561-973b-f87064855d6a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.537842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e19e1-b809-4561-973b-f87064855d6a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.538296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e19e1-b809-4561-973b-f87064855d6a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.540546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 198/397] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:19.541524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e19e1-b809-4561-973b-f87064855d6a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.648720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.651539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195539-c462-4047-9db1-ecb4f54da98d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.694877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e19e1-b809-4561-973b-f87064855d6a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.708380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.709433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.709918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.710397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.711440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:19.712634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.713974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da048-130e-4803-8ca1-ed770efc37a3 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.725157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 200/398] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:19.727680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba89fb-e95c-4726-a06d-8c2cf2202d66 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.727680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba89fb-e95c-4726-a06d-8c2cf2202d66 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.728043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba89fb-e95c-4726-a06d-8c2cf2202d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.752711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4fba89fb-e95c-4726-a06d-8c2cf2202d66 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:19.754702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4fba89fb-e95c-4726-a06d-8c2cf2202d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:19.767805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:19.768734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.769163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.769594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.772723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb955df355413dbbf55747b50d9a06, group_id=f99091643e9b488aa9081dd7bbdfa36c, role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:19.774479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:19.800057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 199/399] 10.222.0.13 () {58 vars in 1442 bytes} [Fri Jun 24 14:15:19 2022] PUT /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:19.800057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:19.831671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:19.872344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 201/400] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:19.873801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb101-a9e0-40d1-952d-59a03247f5e3 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.874140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb101-a9e0-40d1-952d-59a03247f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.874423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb101-a9e0-40d1-952d-59a03247f5e3 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.875789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 202/401] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:19.894328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:19.894707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:19.894985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:19.918098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:19.919229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:19.975378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990080cd-25c0-414b-83de-1ccca4625bbc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:19.987957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.022930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 203/402] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:20.028687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.046239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.047612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.048130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.048794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.056055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.058935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.062281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 200/403] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:19 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:20.068065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.158448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0695-6207-4d19-b0f4-3e218760d99d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.172938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.206512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e9c35-371f-49c6-a53d-b650b2a5bf43 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.221323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.222633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.222921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.223417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.245573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:20.260920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:20.261884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:20.262750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:20.263373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 204/404] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:20.265543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.273008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.274897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.275390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.275922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.277565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.279290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.281913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 201/405] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:20.283057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.342213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.403462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b92c-b838-464f-8277-fdf889dc70d7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.411481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f3ac-d007-4fc6-a7be-b3650476198b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.457145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.457855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.458150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.458401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.462692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.464171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.465024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.465947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.467815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:20.468414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.469520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:20.471297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:20.478594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:20.479685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 205/406] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:20.481393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.491033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 202/407] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:20.498064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.518853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.609637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4319d-e470-4261-b003-3d6ba0ff0069 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.663815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.664908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.665192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.665545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.666103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3cc5-9042-4b36-91d9-7114a77eeca6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.667724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, group_id=f99091643e9b488aa9081dd7bbdfa36c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.669655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.677412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.692157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 206/408] 10.222.0.13 () {58 vars in 1442 bytes} [Fri Jun 24 14:15:20 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:20.694754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.730254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.731885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.732902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.733831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.736012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:20.736899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.738801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.750852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 203/409] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:20.761631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.857487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:20.881664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917522b-139a-4965-bf30-2b022d2cc55a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.923864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.924783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.925065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.925444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.926749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.928345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:20.930654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 207/410] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:20.936122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:20.954933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc3f5-ddba-4c72-8324-061cc3de0141 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:20.992783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:20.994056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:20.994350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:20.994620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] PATH_INFO: `/v3/groups/2e0afb372f5044b0b0690015ed1e4664` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:20.995982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] RBAC: Authorizing `identity:get_group(group_id=2e0afb372f5044b0b0690015ed1e4664)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:20.997936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:21.000445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 204/411] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/groups/2e0afb372f5044b0b0690015ed1e4664 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:21.006728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:21.073088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:21.093474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0144542-7124-467c-99bb-3e0b76b35410 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:21.175051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:21.176820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:21.177322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:21.178493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:21.182006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:21.184237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:21.190587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 208/412] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:20 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:21.194013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:21.207207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122ffd7-11dd-4d2b-a38c-56eb1d7ac035 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:21.241372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:21.289543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:21.290412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:21.290691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:21.290962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] PATH_INFO: `/v3/projects/ece624c61ff74175ac0fde255f3115b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:21.293249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] RBAC: Authorizing `identity:get_project(project_id=ece624c61ff74175ac0fde255f3115b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:21.294715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:21.296545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 205/413] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:21 2022] GET /identity/v3/projects/ece624c61ff74175ac0fde255f3115b8 => generated 344 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:21.302585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:21.390558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6348-a1fd-4c75-beee-0420572132dc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:21.453683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:21.454566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:21.454847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:21.455124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:21.462274 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c1476c37a47d6b9fc87a62e562033, group_id=f99091643e9b488aa9081dd7bbdfa36c, role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:21.463747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e27551-347a-4c9e-a274-9368349a8e6b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:21.487263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 209/414] 10.222.0.13 () {58 vars in 1442 bytes} [Fri Jun 24 14:15:21 2022] PUT /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033/groups/f99091643e9b488aa9081dd7bbdfa36c/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:21.515270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d174f-88a7-49cb-9a63-774636cd9a8f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:21.518858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:21.562468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:21.563325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:21.563607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:21.563880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] PATH_INFO: `/v3/projects/ece624c61ff74175ac0fde255f3115b8/groups/2e0afb372f5044b0b0690015ed1e4664/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:21.569668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] RBAC: Authorizing `identity:create_grant(project_id=ece624c61ff74175ac0fde255f3115b8, group_id=2e0afb372f5044b0b0690015ed1e4664, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:21.571239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f26e-fb4a-4196-be8f-04b38e65f3fd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:21.590850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 206/415] 10.222.0.13 () {58 vars in 1442 bytes} [Fri Jun 24 14:15:21 2022] PUT /identity/v3/projects/ece624c61ff74175ac0fde255f3115b8/groups/2e0afb372f5044b0b0690015ed1e4664/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:15:22.125962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652e67-edd2-4c56-a3ff-a31060d46b8b None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.126477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652e67-edd2-4c56-a3ff-a31060d46b8b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.126577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652e67-edd2-4c56-a3ff-a31060d46b8b None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.128140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 210/416] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:22.137292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c829-3806-430f-9055-92803c813acd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.137755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c829-3806-430f-9055-92803c813acd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.137829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c829-3806-430f-9055-92803c813acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.173264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2b94c829-3806-430f-9055-92803c813acd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:22.174493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2b94c829-3806-430f-9055-92803c813acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:22.183472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2c08-8a42-40df-bb46-68007aa6aa24 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.184219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2c08-8a42-40df-bb46-68007aa6aa24 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.184711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e2c08-8a42-40df-bb46-68007aa6aa24 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.186302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 211/417] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:22.192229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.192798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.193275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.237007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:22.243249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:22.294916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 207/418] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:22.335660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c829-3806-430f-9055-92803c813acd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:22.362924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 212/419] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:22.389086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:22.414204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:22.466849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:22.480768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c829-3806-430f-9055-92803c813acd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:22.565745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:22.566744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.567122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.567497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.593616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:22.612364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:22.615387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:22.625347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 208/420] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:22.627624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:22.638291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908596b6-4d90-4516-9f27-e9567b23cb1d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:22.702183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:22.703477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.704073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.704514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.720091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:22.729603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:22.730497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:22.731271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:22.734124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 213/421] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:22.742839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:22.832946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679cd4-2eaf-4817-a738-a48b8a014366 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:22.871571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:22.872622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:22.873106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:22.873607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:22.874557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:22.875057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:22.876909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:22.887892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 209/422] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:22.894115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:22.917017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:22.968492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.010325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e780-514e-454a-b4f9-dfd8ce685edd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.046990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.048010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.048538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.049009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.090112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361806-c003-4461-95dd-943f7dd0664f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.131940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.134590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a130b-2868-41b1-8480-911e664ccb46 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.143673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.144378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.144662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.144938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.145693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:23.145997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.147387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef57be-e41b-428a-b0b6-8388a103a169 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.156476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 214/423] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:23.157805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f8ff-9e5c-4119-aedb-d6fe338d329b None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.158098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f8ff-9e5c-4119-aedb-d6fe338d329b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.158381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f8ff-9e5c-4119-aedb-d6fe338d329b None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.159816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 215/424] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:23.165010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3f8ff-9e5c-4119-aedb-d6fe338d329b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.172495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.273796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 210/425] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:23.273796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.273796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.273796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.290772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:23.291960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:23.297287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3f8ff-9e5c-4119-aedb-d6fe338d329b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.341925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.343384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.343880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.344619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.364847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 211/426] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:23.372790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.380423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.433004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.435279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.442499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.501068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a357-7d80-4d20-988e-b0356c766849 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.537841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.539046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.539157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.539364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.541118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.542589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.548146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 212/427] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:23.548146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.574994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 216/428] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:23.576353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.621083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.675734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974515-4ce4-49a3-9d7a-fa9a2c9fd7b7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.690231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c150b-7349-426f-ab21-ecbfbf3cbf35 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.693364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.716715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.717893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.718378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.718851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.728168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.729072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.729358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.729631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.730887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.731875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:23.732373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.740388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 217/429] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:23.741923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:23.745505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:23.746894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:15:23.748261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:23.758846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 213/430] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:23.760450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.856327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519edf-bcac-4aea-980d-0ce6fbf96e8f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.864624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:23.894640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.895767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.896226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.896659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] PATH_INFO: `/v3/projects/8eeb955df355413dbbf55747b50d9a06` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.898008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] RBAC: Authorizing `identity:get_project(project_id=8eeb955df355413dbbf55747b50d9a06)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.900157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:23.902005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 218/431] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/projects/8eeb955df355413dbbf55747b50d9a06 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:23.902987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:23.929588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427577f-1a3a-4d2a-9639-5a3de8e7e040 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:23.983829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:23.984949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:23.985293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:23.985764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:23.987120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=8eeb955df355413dbbf55747b50d9a06) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:23.987875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:23.989909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.004823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 214/432] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.004823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.035451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7af0d-2751-4a76-9887-903af08333c7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.069785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.086732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.087411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.087716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.087955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.088760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] RBAC: Adding query filter params (name=member) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:24.089064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.090491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca84e4-3aa3-4a7f-8376-64a0cea596af None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.105650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 219/433] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.107426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a5cd-16d3-4780-a790-afe0197b2c90 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.107949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a5cd-16d3-4780-a790-afe0197b2c90 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.108465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a5cd-16d3-4780-a790-afe0197b2c90 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.114620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 220/434] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:24.116523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.117730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.118225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.137555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:24.139155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:24.157013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58790e-4ff9-462b-b6c0-3b8b3ae9c008 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.173248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.195336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.196288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.196571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.196887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.198148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.199615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.201322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 215/435] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.203265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.230804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 221/436] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:24.231959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.340182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446ef0-f077-460c-bc34-8fc0a77c82db None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.348273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.372849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4563-8a5e-4c9f-89c4-b33f9c5293b1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.381775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.382420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.383275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.383549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.416877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.417824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.418317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.418605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.419421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=8eeb955df355413dbbf55747b50d9a06) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:24.419725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.421201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.427269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 222/437] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=8eeb955df355413dbbf55747b50d9a06&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.428660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.469835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.488574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.490083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.554144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9225c-c869-4757-8bcc-fb59e4c76941 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.592299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.592944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.593230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.594181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.606495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-66410c28-8fb4-4490-9c71-9d8e5deb440c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:24.615174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:24.616059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:24.616868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 223/438] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:24.618323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849b04-183c-4c0c-bbb6-f57e87e2bf51 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.618604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849b04-183c-4c0c-bbb6-f57e87e2bf51 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.618873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b849b04-183c-4c0c-bbb6-f57e87e2bf51 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.621894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 216/440] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:24.622962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.625268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 224/440] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:24.626896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.627182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.627510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.632369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.645099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:24.646430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:24.730325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 225/441] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:24.731085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.743714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae6b7-605f-4a24-a6c4-37103592075d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.757392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.784704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.785635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.785635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.785908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.786657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:24.786961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.789927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.801020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 217/442] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.805725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.847390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e211da-4a91-4763-bf32-6b8596464298 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.874861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:24.888555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.889916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.890368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.890820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.892613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:24.895021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:24.897936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 226/443] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:24.899155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.921237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abfc8d-c3df-4b12-a4f5-2a28c2be53ad None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:24.954985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:24.955764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:24.956065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:24.956342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:24.966259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:24.973837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:24.974872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:24.975700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 218/444] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:24.977016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:24.991111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.003773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d930d-3dcb-4145-a947-6f1c840fbdba None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.036315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.036946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.037243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.037513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.074322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631948eb-3830-4c51-8653-efddd77c2d3c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.100305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.105087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.106551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.109100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.110021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.110301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.110572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.111743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.113220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.114829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 219/445] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.115578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.195348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.208247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 227/446] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:25.209049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.212802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939b37-e75b-4505-a4ae-37d8b944b506 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.247368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.248049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.248339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.248614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.249356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:25.249662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.251039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.259108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 220/447] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.259920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.315248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663879ed-e349-4fac-bc3a-cdad3cd4224d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.318508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.349271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.349907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.350184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.350508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.351282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=2bfcd0e9346b4c9cb796e54313815a05, scope.project.id=a93c1476c37a47d6b9fc87a62e562033) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:25.351851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.353307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.359074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 228/448] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=2bfcd0e9346b4c9cb796e54313815a05 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.359831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.361445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42647d-9051-4a7a-bfda-5a6d8e65a93f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.400451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.401314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.401596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.401870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] PATH_INFO: `/v3/projects/a93c1476c37a47d6b9fc87a62e562033` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.403145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c1476c37a47d6b9fc87a62e562033)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.404779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.411222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 221/449] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/projects/a93c1476c37a47d6b9fc87a62e562033 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.412537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.425983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.480708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66497c-86ad-4321-86f4-7e482f41a042 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.519060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.519712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.519990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.520313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.526212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873be-3443-4659-84b8-6212e96acfc7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.554881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.565955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.566803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.567079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.567349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] PATH_INFO: `/v3/groups/f99091643e9b488aa9081dd7bbdfa36c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.568550 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] RBAC: Authorizing `identity:get_group(group_id=f99091643e9b488aa9081dd7bbdfa36c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.570040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.571984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 222/450] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/groups/f99091643e9b488aa9081dd7bbdfa36c => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.577439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.602388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.603905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.667659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.698796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89069d-5841-4b4c-b4d1-54d0308e22ac None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.729547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 229/451] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:25.734896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.741654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.742333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.742611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.742908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.743735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] RBAC: Adding query filter params (group.id=f99091643e9b488aa9081dd7bbdfa36c, role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=a93c1476c37a47d6b9fc87a62e562033) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:25.744067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.745501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.751215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 223/452] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/role_assignments?group.id=f99091643e9b488aa9081dd7bbdfa36c&scope.project.id=a93c1476c37a47d6b9fc87a62e562033&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:25.834975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1d7c6-a5e8-487c-bc1c-6a2fbcd07c2b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:25.870428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:25.871200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:25.871476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:25.871751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] PATH_INFO: `/v3/projects/ece624c61ff74175ac0fde255f3115b8` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:25.872995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] RBAC: Authorizing `identity:get_project(project_id=ece624c61ff74175ac0fde255f3115b8)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:25.874467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:25.876211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 230/453] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/projects/ece624c61ff74175ac0fde255f3115b8 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:25.881893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:25.942354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:25.990381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8889f-48fe-4836-a311-50abad319f31 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:26.024432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:26.025279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:26.025556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:26.025829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] PATH_INFO: `/v3/groups/2e0afb372f5044b0b0690015ed1e4664` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:26.027005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] RBAC: Authorizing `identity:get_group(group_id=2e0afb372f5044b0b0690015ed1e4664)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:26.028488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26102f1b-0ad1-4d8e-bd90-e48a0566f280 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:26.030382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 224/454] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Jun 24 14:15:25 2022] GET /identity/v3/groups/2e0afb372f5044b0b0690015ed1e4664 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:26.035900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:26.058198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:26.134129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251a3e-b1fa-4741-8292-0ed557789edd None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:26.166649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:26.167289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:26.167570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:26.167843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:26.168690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] RBAC: Adding query filter params (group.id=2e0afb372f5044b0b0690015ed1e4664, role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=ece624c61ff74175ac0fde255f3115b8) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:26.169001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:26.170426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564948b4-b01c-4eef-a1fe-7a8127545d02 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:26.175988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 231/455] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Jun 24 14:15:26 2022] GET /identity/v3/role_assignments?group.id=2e0afb372f5044b0b0690015ed1e4664&scope.project.id=ece624c61ff74175ac0fde255f3115b8&role.id=2f3ba2869328424982c43c608f72cb4e => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:28.618212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643960-ce5f-4956-bfec-6844e06f7344 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:28.618727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643960-ce5f-4956-bfec-6844e06f7344 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:28.618827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643960-ce5f-4956-bfec-6844e06f7344 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:28.620366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 225/456] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:28.625610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9786eb-4b65-402c-bdcd-ff8088a1bc53 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:28.625996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9786eb-4b65-402c-bdcd-ff8088a1bc53 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:28.626160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9786eb-4b65-402c-bdcd-ff8088a1bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:28.649487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0f9786eb-4b65-402c-bdcd-ff8088a1bc53 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:28.650663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0f9786eb-4b65-402c-bdcd-ff8088a1bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:28.742634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 232/457] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:28.771387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed46af-ae10-445f-8d98-2eb55726a4e9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:28.771667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed46af-ae10-445f-8d98-2eb55726a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:28.771942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed46af-ae10-445f-8d98-2eb55726a4e9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:28.774198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 226/458] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:28.779640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:28.779927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:28.780227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:28.783488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed46af-ae10-445f-8d98-2eb55726a4e9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:28.798308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:28.799479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:28.812469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:28.924399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 233/459] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:28.951032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:28.989703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed46af-ae10-445f-8d98-2eb55726a4e9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.028655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.036671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.037467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.037752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.038157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.063263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.064897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:29.093295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:29.094198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:29.095025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:29.095025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:29.095025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.095025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:29.096256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 227/460] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:29.105646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.114422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ac14-797c-4232-8f79-b3ead27bc156 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.164332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.165182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.165636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.165921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.177021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.178489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:29.197722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:29.198591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:29.199442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:29.199442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:29.199442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.199442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:29.199658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 234/461] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:29.200557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.204891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.296412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f385a-68f8-47fa-a7a8-ca2b1544b5b0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.332703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.334349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.334862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.335547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.337076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:29.337604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.338746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6f77f-e130-4936-92ed-48a1dee28373 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.339337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b01876-35e3-4a7c-a6f2-c46cbfd9fbfd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.362933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 228/462] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:29.364568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67828-053f-453d-9b45-43462485d4d5 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.364995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67828-053f-453d-9b45-43462485d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.365456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd67828-053f-453d-9b45-43462485d4d5 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.371516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 229/463] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:29.372514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd67828-053f-453d-9b45-43462485d4d5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.380418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.381081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.381372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.381650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.383350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:29.383845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.385767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793f99d-c71e-481f-8b59-b2311bf0ada0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.402266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 235/464] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:29.404525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.404968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.405417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.417973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.426879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:29.428635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:29.485947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd67828-053f-453d-9b45-43462485d4d5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.493641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.512457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 236/465] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:29.513733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.537632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.538421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.539289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.539631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.540461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.541994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.577122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 230/466] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:29 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:29.578248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.645652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24209-c7c2-455e-8d16-c02e14f138f0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.689732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.690332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.690615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.690895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.691616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.693137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03811c33-85a5-4b5d-9a4e-c7e03a72f959 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.717468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 237/467] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:29 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:29.719146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e7d-93b0-4950-9acc-ff6b6528ac2e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.719442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e7d-93b0-4950-9acc-ff6b6528ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.719725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e7d-93b0-4950-9acc-ff6b6528ac2e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.721576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 238/468] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:29.728713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.739157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd996e-ce89-431b-b510-4b6475abb5d6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.739476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd996e-ce89-431b-b510-4b6475abb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.739714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd996e-ce89-431b-b510-4b6475abb5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.740392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8efae-0eab-4a59-be0d-92a0c128ff98 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:29.761643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a7bd996e-ce89-431b-b510-4b6475abb5d6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:29.762927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a7bd996e-ce89-431b-b510-4b6475abb5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:29.805464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:29.809334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:29.811297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.811813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.812314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.829384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:29.831611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:29.845382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:29.853568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:29.854592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:29.855632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:29.855632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:29.855632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:29.855632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:29.857336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 231/470] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:29.858536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83422-c3fd-42be-a9ce-fec48bffc294 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.858898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83422-c3fd-42be-a9ce-fec48bffc294 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.859247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83422-c3fd-42be-a9ce-fec48bffc294 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.865739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 240/471] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:29.866292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:29.872333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:29.872920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:29.873393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:29.891991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:29.893558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:30.004122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 241/472] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:30.004122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.027636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2d09-70af-4b32-bbb4-7a42f17b060d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.086047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.086517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.086808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.087496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.087815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:30.088896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.092593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.110393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 232/473] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:30.111221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.127380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.150178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c19a-f192-4564-9467-dd1cc7e9a27a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.152146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.213875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.214671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.214954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.215228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.242395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.243897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.261486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505e9c-2701-4957-b774-21e31b34f5dc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:30.290886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:30.291839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:30.292708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:30.292708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:30.292708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:30.292708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:30.298489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 242/474] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:30.301697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.318381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.319354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.319818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.320275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.321167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.322734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.331281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.sql.core [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:15:30.331281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 14:15:30.331281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [parameters: {'id': 'ce3a61dc50e542f3b4df7449dfa0b234', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 14:15:30.331281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80140) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() Jun 24 14:15:30.359825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:15:30.360867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application yield resource Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise self.value Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application session.commit() Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 14:15:30.361845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.flush() Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application compat.raise_( Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 14:15:30.362679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:15:30.363539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:15:30.364426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [parameters: {'id': 'ce3a61dc50e542f3b4df7449dfa0b234', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:30.365266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 14:15:30.366036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:30.373326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 233/475] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Jun 24 14:15:30 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:30.374492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.479050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121c6b-6750-4000-b9ee-6f51e8520f4b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.480115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.521025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f665-8bf3-4a15-be6c-65d5ec834a64 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.533552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.534224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.534509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.534783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.535711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.536962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.564547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.565595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.566084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.566551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.567564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:30.568072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.568453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 243/476] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:30 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:30.569409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.570792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.592768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.596581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 234/477] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:30.602585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.701472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e869cb-91bc-4954-95f1-52372a774d60 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.749680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.750516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.750803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.751080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.780053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:30.788369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:30.789888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:30.790694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 244/478] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:15:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:30.803954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:30.812906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f523c-a2cf-45d1-a8e8-a6abe3d27ae6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.858529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.864916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.865935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.866421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.867042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.868276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.870438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10b791-1627-4c41-885b-0acbb4122efc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:30.894150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 235/479] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:30 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:15:30.905142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:30.947584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994b792-53eb-43b6-947c-f97be1c5d006 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:30.992718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:30.993710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:30.994216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:30.994666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:30.995682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:30.996192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:30.997820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39740c-0f9f-4c08-9d62-5748312f3b65 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:31.008661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 245/480] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:32.026128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72393c-8ada-48e0-8c72-930ed08b399e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.026680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72393c-8ada-48e0-8c72-930ed08b399e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.026680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72393c-8ada-48e0-8c72-930ed08b399e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.028320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 236/481] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:32.033234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b0554-bc6f-4609-ab53-70b4cd90d3e1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.033632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b0554-bc6f-4609-ab53-70b4cd90d3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.033831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b0554-bc6f-4609-ab53-70b4cd90d3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.055831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6e8b0554-bc6f-4609-ab53-70b4cd90d3e1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:32.057045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6e8b0554-bc6f-4609-ab53-70b4cd90d3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:32.140726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 246/482] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:32.172272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72393c-8ada-48e0-8c72-930ed08b399e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.206525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a914e-1b94-4896-8804-dac131a5d3f8 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.206820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a914e-1b94-4896-8804-dac131a5d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.207085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a914e-1b94-4896-8804-dac131a5d3f8 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.208637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 247/483] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:32.215239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.215239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.215239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.239778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:32.243012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:32.350002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72393c-8ada-48e0-8c72-930ed08b399e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:32.370101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:32.390502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 248/484] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:32.404458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:32.405285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.405567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.405840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.417371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:32.421589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:32.425588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:32.426493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:32.427489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 237/485] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:32.436586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.488389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:32.550809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab0b2-58ee-4c78-92e7-69dcdc255ef9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:32.591199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:32.591866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.592173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.592453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.593208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:32.593515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:32.594910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:32.599283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7b582-c177-4a1e-99ca-029917ed21ec None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:32.622142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 238/486] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:32.627427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.667943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:32.668763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.669045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.669319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.685931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:32.693975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:32.695658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:32.696595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 249/487] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:32.703774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.803408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07903d-a1ab-4a08-90e0-c2ac3b584494 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:32.806099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:32.816456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:32.846752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:32.848412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.848895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.849363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.862337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:32.864147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:32.893818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:32.894667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:32.895485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:32.895485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:32.895485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:32.895485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:32.898213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 239/488] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:32.903844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:32.918809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b53a-404d-43bb-bbac-0d4889d69f57 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:32.988704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:32.989931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:32.991161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:32.992355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:32.993483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:32.994939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:32.996756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.014047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 250/489] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:33.019596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.074958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d76c-c3ab-48f1-97b4-5e7d4c5da711 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.112959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.113622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.113902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.114176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.114903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:33.115206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.116652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.142480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 240/490] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:33.150376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.181877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ccc4-d0f2-4b3e-9476-2a148a7e149f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.196174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.208958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.246953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.248213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.248691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.249155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.261459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.263456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:33.283517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:33.284407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:33.285347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:33.285347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:33.285347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:33.285347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:33.287929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 251/491] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:33.294586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.312739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa981c-9463-41cd-a7f5-cbcbbcb10bd0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.347696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.348514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.348796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.349096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.357367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.358827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:33.375259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:33.376289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:33.377172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 241/492] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:33.382125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.415120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a9bfa-e871-4d55-bc98-d027d8af20b5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.453664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.454770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.455248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.455714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.456660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:33.457179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.458853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.465102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.473440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 252/493] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:33.481055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.494690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cbe6-fa10-4e32-bbff-2b0b1f6247f1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.511541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.536663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.537330 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.537682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.537875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.539279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:33.539585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.541222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58b5a-72fa-4127-afc6-7502cd995a90 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.584108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 242/494] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:33.586764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a626a1-d233-40f3-8266-057c33d916bb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.587068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a626a1-d233-40f3-8266-057c33d916bb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.587554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a626a1-d233-40f3-8266-057c33d916bb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.589086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 243/495] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:33.590079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec828-81f6-4f13-840d-1f6bb11dd948 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.590469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec828-81f6-4f13-840d-1f6bb11dd948 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.590757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec828-81f6-4f13-840d-1f6bb11dd948 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.592139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 244/496] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:33.596457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddec828-81f6-4f13-840d-1f6bb11dd948 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.597906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa2cc0-41e9-4fae-a17c-91a8bbec6780 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.637291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.638349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.638627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.638894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.647031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.648561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-44b4d922-c822-498e-bd49-3ab14498eeb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:33.665709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:33.666622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:33.667822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 253/497] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:33.672417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9475e-93da-46d0-9882-be6d04bfa0ce None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.672699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9475e-93da-46d0-9882-be6d04bfa0ce None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.672974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9475e-93da-46d0-9882-be6d04bfa0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.690363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a8d9475e-93da-46d0-9882-be6d04bfa0ce None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:33.691773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a8d9475e-93da-46d0-9882-be6d04bfa0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:33.703408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddec828-81f6-4f13-840d-1f6bb11dd948 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.736381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.736954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.737220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.737498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.745973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.758460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 254/498] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:33.759804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15de0e-ce41-4efe-b5d0-7b6885d5f8be None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.760122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15de0e-ce41-4efe-b5d0-7b6885d5f8be None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.760399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15de0e-ce41-4efe-b5d0-7b6885d5f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.776549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2b15de0e-ce41-4efe-b5d0-7b6885d5f8be None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:33.777728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2b15de0e-ce41-4efe-b5d0-7b6885d5f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:33.788656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.814743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.816240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:33.844854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 255/499] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:33.846139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb5df-8bc8-47f7-9e53-89e200681b19 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.846425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb5df-8bc8-47f7-9e53-89e200681b19 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.846696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb5df-8bc8-47f7-9e53-89e200681b19 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.848006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 256/500] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:33.848698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb5df-8bc8-47f7-9e53-89e200681b19 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.927077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 245/501] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:33.927824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:33.947025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb5df-8bc8-47f7-9e53-89e200681b19 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:33.967391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:33.981451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:33.982109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:33.982393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:33.982671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:33.983506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:33.983816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:33.985320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3452af-9df3-433c-84bd-965f309a6356 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.023554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 257/502] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:34.024946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e874411-d982-41da-8bdd-2406529a547d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.025242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e874411-d982-41da-8bdd-2406529a547d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.025520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e874411-d982-41da-8bdd-2406529a547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.031354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.034453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba7366-5f5a-48d3-803f-22c56d4c86a7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.042262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7e874411-d982-41da-8bdd-2406529a547d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:34.043464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7e874411-d982-41da-8bdd-2406529a547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:34.068350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.069039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.069315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.070097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.079865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:34.088044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.088941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:34.089724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 246/503] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.090567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.113631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 258/504] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:34.114455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e874411-d982-41da-8bdd-2406529a547d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.193357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.197525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83e08-72dd-40fe-b2ba-aa5cde8c2cd3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.212160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e874411-d982-41da-8bdd-2406529a547d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.232963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.233755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.234039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.234313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.245382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:34.247885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.248701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.248979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.249251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.251131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:34.253202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.254101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:34.255180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 247/505] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.255971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.259954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.261815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:34.280571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.281581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.282447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:34.282447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:34.282447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.282447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:34.282447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 259/506] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.282722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.360118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91151d3-5581-4bdd-9ec8-bf3778cc8a89 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.389014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21322-0385-4b1a-8727-23d8a8db0d94 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.393271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.393910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.394194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.394472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.421322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.423232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.423896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.424208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.424488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.425236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:34.425542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.426936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.434845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 260/507] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:34.435635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.465662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.467043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.483132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.536866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63774d-0373-4a99-966d-2235d2032973 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.567105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 248/508] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:34.567979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.569808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.570688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.570966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.571244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.581725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.583194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:34.600541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.602359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.603378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:34.603378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:34.603378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.603378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:34.604879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 261/509] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.605832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.626083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.674260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d888-aee2-417f-ab0d-5244fd557916 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.712126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.712320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.712872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.713159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.713449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.714189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:34.714495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.714983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0151b-16b8-48dd-94c3-6ef5e5f57960 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.715943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.724191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 249/510] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:34.724983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.749730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.750392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.751072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.751072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.752135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:34.752457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.753861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.765616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 262/511] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:34.766406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.824403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6bcdf-c16b-45d9-8046-842e025f2d30 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.843738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.858669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.859521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.859798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.860097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.866300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29198d7b-750b-4120-98a1-e1abe76d083c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:34.870972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.872458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:34.889292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.890137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.890962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:34.890962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:34.890962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.890962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:34.890962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 250/512] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.891632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.905145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:34.905924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:34.906202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:34.906471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:34.917371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:34.918826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:34.937112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:34.938122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 263/513] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:34.939049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:34.955482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:34.997368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741783f-0ae5-4bfd-b5d7-6577f1ee7dcc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.030920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.031571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.031848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.032141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.032879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:35.033178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.034568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.042800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea5d7-5dfc-4f75-8b01-c488a66992ee None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.046747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 251/514] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:35.047517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.077485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.078381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.079201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.079509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.079823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.089857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.091313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:35.108551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:35.109548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:35.110497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:35.110497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:35.110497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:35.110497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:35.110497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 264/515] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:35.110921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.157058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a010-8b73-4712-904b-271e2f18ddde None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.182455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.203983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.204803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.205097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.205378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.213155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.221118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.230331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89805-420f-4bfd-b38c-5711ac3c3e0b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:35.237646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:35.238538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:35.239368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 252/516] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:35.239842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.279170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.279899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.280299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.280585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.281556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:35.281967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.284198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.299841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 265/517] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:35.302983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.349086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.358646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43992078-ceb6-4f61-b90f-8f00182f3d11 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.396397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.397053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.397337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.397697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.398408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:35.398408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.399978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.412437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 253/518] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:35.413247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.414538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177f6-1c0f-4308-a4e9-e7986d4124c2 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.439919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.451845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.452617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.452913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.453193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.453975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.455534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.476953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 266/519] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:35 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:35.489118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.542543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298e97-326f-429e-a14a-7b30f7347db2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.582033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.582711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.582996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.583271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.584005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:35.584342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.585859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.604260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 254/520] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:35.606171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.618209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de231-fb4c-46ee-bfe8-543122e275f0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.629829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.663146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.664435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.664848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.665121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.665926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:35.666234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.667708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.689384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 267/521] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:35.691196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.738165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.743857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7d048-89d8-424b-a020-042a1a3b9a38 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.781376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.782172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.782453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.782728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.793887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.795268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.805083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77fb82-4885-43fa-85c6-a0bc4b49f6d9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:35.810912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:35.811798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:35.812693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 255/522] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:35.813243 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.847167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.848084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.848464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.848744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.856419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.857949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:35.873768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:35.874765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:35.875612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 268/523] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:35.876111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:35.894228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.927728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d8d3c-d8a0-4b0a-9705-a00919a0ce2a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.969298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:35.970881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:35.971391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:35.971892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:35.984553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:35.985412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:35.987728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac228-651c-47d5-8f00-ad428914468d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:35.988426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:36.009696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:36.010742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:36.011865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:36.015533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 256/524] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:36.016429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.033557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.033974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.034258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.034537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.035436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:36.035717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.037174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.052143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 269/525] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:35 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:36.052143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.159984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8205b4-a4cf-478e-81ab-3e6930176ae1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.197042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.202345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.203201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.203398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.203656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.204547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:36.204848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.206303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.207676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e078ba-b414-4de5-8ab4-20781c4fd50c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.232682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 257/526] 10.222.0.13 () {56 vars in 1139 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:36.233670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.260643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.262177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.263031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.263451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.264651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:36.265439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.268913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.286907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 270/527] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:36.287956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.315633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.364759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011b1b-5dce-418c-9ff9-1e0871125d80 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.400299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7dcbba-34ce-43a5-ae55-9b50a5b26b7b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.402770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.403992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.403992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.403992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.404821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:36.405127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.406569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.429745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 258/528] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:36.430564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.439166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.440130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.440615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.441215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.484080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.517086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.518895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.541793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e480a4-3cf5-4c3a-b9bc-f30631cfab78 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.546536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.578538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.579207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.579505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.579780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.580711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=4d3b4e1e918440858a0f10b8eadb4f52) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:36.580984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.582444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.589350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 259/529] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/role_assignments?user.id=4d3b4e1e918440858a0f10b8eadb4f52&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:36.590235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.636099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 271/530] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:36.641215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.775366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfd379-1773-4d82-b104-9a1942058685 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.798225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09cdd2-e994-4432-b4d9-92b4d122525c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:36.812513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.827880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.832105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.833041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.833401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.833654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:36.855742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.857293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:36.880387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:36.882013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:36.883049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:36.883524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:36.889844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:36.890725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:36.891565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:36.891565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:36.891565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:36.891565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:36.891565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 272/531] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:36.896682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:36.971872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:36.973779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.017166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6745-5a58-4693-baf5-1c24c8c894b3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:37.117284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 260/532] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:37.123023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:37.129000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:37.130482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.131083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.131762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.133873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:37.134541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:37.137457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.153436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:37.162485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 273/533] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:37.169984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:37.254300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0844ab6-6ec9-449b-a249-1fd33d8b5c39 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:37.280337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:37.311602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:37.313801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.314089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.314365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.337782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:37.339258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:37.378407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:37.379525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:37.380697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:37.380697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:37.380697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:37.380697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:37.384005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 261/534] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:37.391251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:37.399233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff44-bfa6-424f-933f-e5116f129247 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:37.514508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391b58e-e766-4745-bee1-64199629448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:37.515907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b58e-e766-4745-bee1-64199629448d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.516620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b58e-e766-4745-bee1-64199629448d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.517122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b58e-e766-4745-bee1-64199629448d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.542641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391b58e-e766-4745-bee1-64199629448d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:37.545649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391b58e-e766-4745-bee1-64199629448d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.562789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-9391b58e-e766-4745-bee1-64199629448d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:37.583794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:37.584724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:37.586115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:37.586980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 274/535] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:37.595218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391b58e-e766-4745-bee1-64199629448d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:37.666164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd9171-0a79-4c5d-9167-5481194fa241 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:37.769084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:37.770604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.771356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.772120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.773656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:37.774427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:37.777246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea733225-c3df-46f0-9c25-a24df2a6c029 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.809349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:37.813797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 262/536] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:37.818280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15327-2dce-4a5e-baf7-6e056cb53a18 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.819104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15327-2dce-4a5e-baf7-6e056cb53a18 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.819847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15327-2dce-4a5e-baf7-6e056cb53a18 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.820834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391b58e-e766-4745-bee1-64199629448d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:37.823136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 263/537] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:37.826064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15327-2dce-4a5e-baf7-6e056cb53a18 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:37.879599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:37.880916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.881386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.881855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.883879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:37.884442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:37.886996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47750a-f72e-4ebc-ae03-c3f66d9d184a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:37.915544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 275/538] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:37.915544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:37.915544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:37.915544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:37.937455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:37.939194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:38.019824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 276/539] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:38.020162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.023644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15327-2dce-4a5e-baf7-6e056cb53a18 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.061024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:38.076083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.077277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.078293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.079039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.089109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:38.091828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:38.110981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:38.111865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:38.112758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:38.115179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 264/540] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:38.116974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.127241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:38.145815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6063c1-10ac-4a62-802d-4dee7ef96984 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.187550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.188417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.188708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.188987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.189892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=d505d66500da43eab82b746d7e7d0875) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:38.190214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:38.192065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:38.200070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 277/541] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/role_assignments?user.id=d505d66500da43eab82b746d7e7d0875&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:38.200070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.303054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8106ee-dbfb-4317-b41a-548a052f1052 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.339907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0fb9f-2b41-4508-803d-10b51558f017 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.386087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.386796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.387078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.387360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.388283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:38.388594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:38.390170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:38.406293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 278/542] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:38.412414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.420513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.421364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.421631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.422026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.447004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:38.457593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:38.475270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:38.477198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:38.478561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:38.482758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 265/543] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:38.490914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.555750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb54f9-6ca1-4a14-a26d-85d0f715e6cc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.595995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.596716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.596995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.597274 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.598132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=60d9764e77334bfba5bf18cdb026bd51) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:38.598447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:38.601710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f4417-fd7b-4b09-ab87-448afe73f8ef None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:38.608382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:38.608560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 279/544] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/role_assignments?user.id=60d9764e77334bfba5bf18cdb026bd51&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:38.671506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236208-ba35-4a3b-af46-0cd38a8b77e9 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.672399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236208-ba35-4a3b-af46-0cd38a8b77e9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.672885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236208-ba35-4a3b-af46-0cd38a8b77e9 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.674867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 280/545] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:38.682084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.682702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.683216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.704767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:38.706603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:38.744062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91478eb-6712-4b89-bcd8-cb7b7995c526 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:38.832013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:38.832754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:38.833040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:38.833433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:38.834807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:38.835709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:38.838461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:38.847044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 281/546] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:38.856551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 266/547] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:38.863629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:38.868266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:38.875155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.095641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2f2b3-495f-450a-bdc8-deeb0fc3899f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.110353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f51ec-cdc9-4fa0-a0ea-56c252fd9bb2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.118661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.159780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.160995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.161498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.161966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.168708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.169529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.169811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.170087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.177104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:39.186103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:39.187023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:39.187936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:39.190986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 267/548] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:39.197145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.198256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.199188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:39.256495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:39.258512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:39.259503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:39.259503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:39.259503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:39.259503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:39.259503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 282/549] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:39.264118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.318058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca396b-51c8-482d-9ba0-ea41bb69bb24 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.359365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.360406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.360894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.361411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.362435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:39.362987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.364616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.374324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 268/550] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:39.380137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.410336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.416627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.502608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4f20-2d01-441c-bf15-536bf7434746 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.537795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b090f-c879-4f8a-858b-82beeecf7a24 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.544886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.546045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.546612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.547161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.560424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.562509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.576855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.577525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.577809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.578078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.578972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:39.579101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.580567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-05bcb006-21f4-4c21-ad27-a81d3bac9874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:39.584986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:39.585933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:39.586874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:39.586874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:39.586874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:39.586874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:39.589295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 269/551] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:39.594418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 283/552] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:39.595397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.596615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0a5a1-cbaa-427b-ba92-07e76c966275 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.597194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0a5a1-cbaa-427b-ba92-07e76c966275 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.597838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0a5a1-cbaa-427b-ba92-07e76c966275 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.600066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 270/553] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:39.601708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0a5a1-cbaa-427b-ba92-07e76c966275 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.699992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.709246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d2b6-356b-42da-a913-ca93c5c25dfb None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.725214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0a5a1-cbaa-427b-ba92-07e76c966275 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.727399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.746592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.747254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.747577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.747806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.748563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:39.748869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.750291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a71970-d458-45a5-8e73-f1ce8638fdd1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.768105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 284/554] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:39.768105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.768105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.768105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.775932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.776985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.777411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.777849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.784850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:39.786198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:39.787667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.789696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:39.807011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:39.807969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:39.808929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:39.811708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 271/555] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:39.812935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.864142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 285/556] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:39.865143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:39.932239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77c910-6f3c-4f8d-a132-b6e6c3415d7e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:39.972397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:39.973535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:39.974096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:39.974607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:39.984892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:39.986828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:39.990266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:39.992278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86ad08-0b4d-4bc4-8c08-1dd7385d2c42 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.000118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:40.010092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:40.011120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:40.012541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:40.019722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 272/557] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:40.021167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.029877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.030559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.030846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.031115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.031962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:40.032311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.034090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.054545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 286/558] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:15:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:40.055439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.141689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87af84-4336-4480-8b9a-b02b099a05bd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.164924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fe3cb-f384-44a1-84f2-0179827e0127 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.181927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.183129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.183762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.184371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.197524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:40.202785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.203455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.203739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.204028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.204907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:40.205217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.206676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:40.208140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:40.209208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:40.210709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:40.213389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 273/559] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:40.214462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.237129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 287/560] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:40.237989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.264607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.290723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.342827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c3380-6229-43b7-b435-0876b7af7023 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.345958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c08879-6899-4d53-8ec9-aa7ff4dd9c2f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.383707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.383957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.384621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.384903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.385177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.385544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.385940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:40.386248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.386349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.386795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.387654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.401813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 288/561] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:40.402811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.467084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.469257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1847-1112-4204-9c25-74c47ba2a865 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.493944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.510738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6716-0b8e-43e9-b0c0-c83c7c3e8338 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.540806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.548567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.549384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.549665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.549940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.564345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.565973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:40.585418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:40.586471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:40.587373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:40.587373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:40.587373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.587373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:40.587373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 289/562] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:40.587661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.598873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 274/563] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:40.601469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e164f3e-73df-4db4-b197-da2184504284 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.602070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e164f3e-73df-4db4-b197-da2184504284 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.602349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e164f3e-73df-4db4-b197-da2184504284 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.603921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 275/564] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:40.604727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e164f3e-73df-4db4-b197-da2184504284 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.702278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90ca7-1749-4863-bcdc-12cea51f9b92 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.716734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e164f3e-73df-4db4-b197-da2184504284 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.748140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.749118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.749504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.749809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.752537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.753040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.753195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.753472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.753747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.754477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:40.754808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.756272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.764815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.766304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.773041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 276/565] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:40.773041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5e11e4d4-a37f-4453-9632-08a98eb941d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:40.790150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:40.791082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:40.791941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:40.791941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:40.791941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.791941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:40.791941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 290/566] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:40.793109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.793460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.793804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.800871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:40.812793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:40.813777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:40.889369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baabeb-2f70-46f8-99a9-c5ad00966d8b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:40.891561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 291/567] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:40.894427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:40.928321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:40.929684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:40.929958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:40.930228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:40.941079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:40.942545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:40.961064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:40.962153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:40.963063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:40.963063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:40.963063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:40.963063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:40.963063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 277/568] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:40.963465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.001182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7390-0e63-4173-8d14-090c72df6493 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.018698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.034270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.037751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.039199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.039474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.039740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.046906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.048395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1d4434ae-f1b3-4fb2-9387-81ef2987a26f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:41.063341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.064382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:41.065243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:41.068243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 292/569] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.071411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901b3c-34e7-4e91-9fde-d147982c9f05 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.071861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901b3c-34e7-4e91-9fde-d147982c9f05 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.072174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901b3c-34e7-4e91-9fde-d147982c9f05 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.073671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 293/570] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:41.073794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f4fc-1de1-4352-9ac3-f1b91627214e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.074404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d901b3c-34e7-4e91-9fde-d147982c9f05 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.110809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.111496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.111764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.112052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.112780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:41.113082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.114452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.127850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 278/571] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:41.128879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.185019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d901b3c-34e7-4e91-9fde-d147982c9f05 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.223407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.224254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.224537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.224812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.236839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:41.240100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980022e7-76bd-4160-ac95-7776d4153e70 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:41.244663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.245593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:41.246428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 294/572] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.247535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.276859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.282559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.283219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.283501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.283827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.284553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:41.284861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.286251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477b6b-f161-45bb-8814-63f6117c3e2f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.292305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.298650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 279/573] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:41.299934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.300261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.300539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.317968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:41.319195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:41.358028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9507-c8dc-4998-9143-9fb142d5c5c9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.387403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 280/574] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:41.388272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.396121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.396786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.397071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.397367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.398163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:41.398473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.399927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.412880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 295/575] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:41.414268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.504547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a46e-df43-405c-9b77-7a5671dc3262 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.510377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.514599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366a043-812e-448b-bdfa-aac393a5e082 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.529446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.542049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.542905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.543110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.543384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.550674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.551093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.551758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.552071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.552165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.552351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.553101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:41.553407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.555402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.563656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 296/576] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:41.564506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:41.567290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.568565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 281/577] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.571319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.670194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca93-0f89-4add-84c8-04427ee56c65 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.671801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fcf4a-259f-46b2-9a83-b3b93c381725 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.706557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.706815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.707360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.707458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.707638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.707730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.707909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.708005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.715516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.717143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.719083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:41.727641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:41.729435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 282/578] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.730420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:41.732190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.733228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 297/579] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.735651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.759004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.778621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:41.836385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203df33-e20e-4d9e-b2ff-c02f1eae988d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.841745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84824-104b-44dc-a8c6-14615bb784ba None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:41.870908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.871788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.872095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.872374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.878484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:41.879294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:41.879610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:41.879919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:41.888078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=0e00c4684e0645eaa796aa1765f7481e, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.889560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.891999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:41.893798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:41.903047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 283/580] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:41 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:41.903881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:41.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:41.914800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:41.915912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:41.915912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:41.915912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:41.915912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:41.919824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 298/581] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:41.920949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.003808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.028521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.041213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c6b24-c509-47c4-947b-2abcc746e1a9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.041429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15ec8-0686-40ba-8e92-8447399f4545 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.082464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.083233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.083524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.083784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.084594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.084923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.086363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.089872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.090482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.090763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.091040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.091887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.092245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.093687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.095730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 299/582] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.096876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.112652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 284/583] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.113514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.206521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab594e4-9bf5-46be-a0e5-214e4bf2458b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.239681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c8ed-da6b-495e-86ab-6165d65dcc08 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.244604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.245518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.245986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.246442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.247407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.247925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.249414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.251352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.265777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 300/584] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.266604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.285270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.285938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.286221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.286496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.287223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.287527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.289496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.301530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 285/585] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.302346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.317148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.387594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75fda-15c4-4d09-8d3e-e2003751f281 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.423721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c956e-f6f3-4db9-8e2b-06e6dc9b5d7e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.425886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.426695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.426979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.427257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.438093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.439572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:42.457981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:42.458934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:42.459824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:42.459824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:42.459824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:42.459824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:42.459824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 301/586] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:42.460681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.468685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.469753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.470237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.470690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.483738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.485536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:42.505005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:42.506027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:42.507665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:42.507665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:42.507665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:42.507665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:42.509429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 286/587] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:42.510391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.519281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.583154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a2d8-3f29-4971-8423-11be469c7f00 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.585091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.627401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.628095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.628381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.628481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15a04-df5a-437e-ab37-8ffa52c56901 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.628666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.629485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=b8263daa298542be9a90840f5417e1f9) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.629822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.633088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.639186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 302/588] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/role_assignments?user.id=b8263daa298542be9a90840f5417e1f9&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.639941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.687711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.689353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.690013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.690680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.702395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.704926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:42.727581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:42.728624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:42.729620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:42.733568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 287/589] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:42.734858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.772047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657969f-c941-4c55-ab1c-8b2a501104eb None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.785649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.815648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.816374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.816657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.816929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.817671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.817966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.820243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.842358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 303/590] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.843055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.892508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230b5f-ed2f-4391-9eaf-416300e3ae66 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:42.916643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:42.931409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:42.932091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:42.932374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:42.932647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:42.933366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:42.933664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:42.935064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:42.953369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 288/591] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:42.953369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:42.974352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccd6e-4f5b-4b93-a51d-ae58423a2b1d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.013153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.013825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.014117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.014393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.015239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:43.015538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.017054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.037098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 304/592] 10.222.0.13 () {56 vars in 1139 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:43.038501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.076289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.103685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea685004-75c5-44a9-9b38-c670f84eee38 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.144478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.145192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.145470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.145739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.154357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.156104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:43.172664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:43.173839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:43.174887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 289/593] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:43.175468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.179192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199db9-a64e-4268-8c9d-b526470538ea None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.233209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.234303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.235344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.235806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.239056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.250964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.252498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:43.267828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:43.268801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:43.269667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:43.274369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 305/594] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:43.275584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.320686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c739b-436c-4999-9fd1-227cdb2559c1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.368983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.371013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.371481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.371941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.384555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.386132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.395903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:43.405583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:43.406500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:43.407411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:43.407411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:43.407411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:43.407411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:43.407411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 290/595] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:43.408428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.412707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1013-8d03-4b3d-a4de-4aa650c4eea1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.452836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.453769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.454326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.454736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.455918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:43.456456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.458140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.479906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 306/596] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:43.481316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.510167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.517906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd356d-0378-43eb-8567-e26f66b14310 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.554841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.555571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.555948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.556344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.557229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:43.557633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.559231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.578651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 291/597] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:43.579667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.599690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64a65-5bf4-4c63-8889-6e732e4c409b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.639950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.641123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.641662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.642083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.642954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:43.643402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.645174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.659451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 307/598] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:43.660626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.671416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.694751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57540b-8dc2-43ea-9d21-8fb50b63c514 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.732350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.733294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.733685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.734121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.745343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.747675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:43.766226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:43.767366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:43.768482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:43.768482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:43.768482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:43.768482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:43.770006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 292/599] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:43.770929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.780376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.787407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27bc1-f23d-495d-a227-cb5f5f455443 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.828275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.829212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.829495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.829771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/4d3b4e1e918440858a0f10b8eadb4f52/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.853543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=4d3b4e1e918440858a0f10b8eadb4f52, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.855263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:43.875079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 308/600] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:43 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/4d3b4e1e918440858a0f10b8eadb4f52/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:43.876371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:43.902167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540b01-d15e-46b4-9b58-e1a923ed62db None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:43.956222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:43.957120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:43.957699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:43.958050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:43.958409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:43.973315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:43.975160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:44.009209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:44.010383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:44.011510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:44.019041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 293/601] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:44.020342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.050434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7f9-6e4e-41df-852c-eecfbb0585cf None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.127883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.128901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.129250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.129593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.130386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:44.130774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.132779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487bf28-f89e-4b70-8ac1-a1c83b527327 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.134079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:44.148541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 309/602] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:44.150559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a185-46c6-484b-b23d-57ad27e3dff5 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.151218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a185-46c6-484b-b23d-57ad27e3dff5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.151558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a185-46c6-484b-b23d-57ad27e3dff5 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.153239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 310/603] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:44.159872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a185-46c6-484b-b23d-57ad27e3dff5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.183174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077c72-bac4-4ca9-8547-a3008413f67f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.234261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.234924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.235203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.235471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.236304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:44.236609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.238057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7679a6-3e3c-4b59-97ef-27ddd2ca2914 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.251966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 294/604] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:44.253400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.253687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.253962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.272794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:44.274006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:44.304478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a185-46c6-484b-b23d-57ad27e3dff5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.323563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:44.344357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.345175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.345458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.345739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.354123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.355597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.365735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 295/605] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:44.367546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:44.382446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:44.383384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:44.384281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:44.387650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 311/606] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:44.389857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.445669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:44.499804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4445df-288e-412f-ad32-9a46b3045121 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.521898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabcc30-ec0c-4db6-b302-0dcd3e31ca5e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.536538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.538875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.539385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.539859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/d505d66500da43eab82b746d7e7d0875/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.558552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=d505d66500da43eab82b746d7e7d0875, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.560482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.562954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.563666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.565653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.565951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.566897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:44.567150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.569014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.578818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 296/607] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:44 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/d505d66500da43eab82b746d7e7d0875/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:44.580048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.588375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 312/608] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:44.590588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.665805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:44.777310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660802-d774-40d5-a51e-2189f3808788 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.787661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19ce-4304-46dc-a886-7e82c6c17a97 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:44.789529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:44.818023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.818999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.819956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.820343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.825301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:44.826532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.827011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.827293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/60d9764e77334bfba5bf18cdb026bd51/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.832504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:44.847180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:44.848379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:44.849246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 297/609] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:44.855078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=60d9764e77334bfba5bf18cdb026bd51, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:44.855562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:44.856673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533872-a9fc-4b6f-a735-d1da41162b4a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:44.882202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 313/610] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:44 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/60d9764e77334bfba5bf18cdb026bd51/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:15:44.947517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac297a-42c7-470f-94fc-08a8b37d842c None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.948232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac297a-42c7-470f-94fc-08a8b37d842c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.948734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac297a-42c7-470f-94fc-08a8b37d842c None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.950611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 314/611] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:15:44.956415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:44.956995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:44.957491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:44.994161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:44.995762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:44.995889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132d23-1472-4854-a137-3c16be1bdf48 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.046346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.046986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.047269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.047546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.048461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:45.048770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:45.054470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:45.073292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 298/612] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:45.081123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.134994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:45.169212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 315/613] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:45.213664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.233001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988fe2e-dd97-4cba-97bd-e270fcc59ee1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.252901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:45.270434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.271227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.271504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.271774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.286532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:45.286532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:45.325976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:45.327103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:45.328229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:45.328229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:45.328229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:45.328229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:45.332863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 299/614] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:45.335473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.402201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f15695-a937-4a1e-ad58-47eb6d200a61 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.452486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.453631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.454075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.454508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.465350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:45.474531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:45.488836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:45.489865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:45.490695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:45.497110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490b32-b29a-4a87-b624-038f891d5231 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.499010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 316/615] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:45.499996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.554786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.555459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.555930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.556230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.556955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:45.557256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:45.559920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:45.586279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 300/616] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:45.597196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.626117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:45.654330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e741-982f-4165-b43e-ad801154f931 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.752281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01679531-206b-4f51-8d01-3073ab34fb2d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:45.763878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.764585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.764912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.765185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.765943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:45.766354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:45.767828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:45.787418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 317/617] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:45.793529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.838800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:45.839633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:45.839881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:45.848045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:45.848453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:45.849988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:45.853750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:45.871786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:45.872846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:45.873777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:45.874386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 301/618] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:45.880333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:45.992514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8dcf2-95c9-4f23-8e93-de67364113eb None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.006488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac49d9-836c-47fa-9baf-3ddae55e650c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.060191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.060441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.060963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.061079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.061243 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.061348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.061508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.061610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.062553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:46.062891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.067832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.077345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.082996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.084777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.088586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 302/619] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:46.096515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:46.126312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:46.127423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:46.128542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:46.128542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:46.128542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:46.128542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:46.129748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 318/620] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:46.136700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.213275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.302017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578a8c-37e3-40e9-9b2f-bddc015430a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.339976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d9b5-a74a-4341-826c-de3fc7f41bad None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.343083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.344260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.344837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.345344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.380391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.380922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.381208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.381508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.382778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:46.383132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.384495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a34f6-a278-4943-af24-fcac74b84e9a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.398196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 319/621] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:46.399301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92f97-e8b1-4adb-9fd9-cb162f3a9bad None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.399592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92f97-e8b1-4adb-9fd9-cb162f3a9bad None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.399870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92f97-e8b1-4adb-9fd9-cb162f3a9bad None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.405281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 320/622] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:46.405281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e92f97-e8b1-4adb-9fd9-cb162f3a9bad None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.437768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.440067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f3fe2-b5d0-46b8-b631-22b698241427 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.477484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.514648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.552814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e92f97-e8b1-4adb-9fd9-cb162f3a9bad None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.569851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 303/623] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:46.571557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.571855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.572161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.594006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:46.595608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:46.609985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.611556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.612082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.613048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.624622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.627366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:46.648406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:46.649372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:46.650345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:46.653873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 321/624] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:46.655625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.675462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 304/625] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:46.676778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.773096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.787026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955b67-7a04-44f7-9291-ac5054114861 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.795549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04888a8-2460-47bd-adca-ddb74264ad3d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.807669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:46.825420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.826096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.826378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.826655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.827496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:46.827812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.829444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.837858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:46.839005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:46.839494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:46.839999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:46.849728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 305/626] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:46.850678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.852695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:46.854538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:46.873951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:46.874898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:46.875792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:46.875792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:46.875792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:46.875792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:46.878150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 322/627] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:46.879326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:46.962097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3295f0-7d2f-4143-b0c8-4dd76f440416 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:46.989944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34c7c-f6d7-43cd-9a57-33ea134f6d41 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.003511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.004350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.004633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.004908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.016451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:47.024960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.025895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:47.026786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:47.029022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.029901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.030250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.030592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.031022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 306/628] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.031898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.042093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.043545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.045327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-569140c9-d009-4312-8099-16e64a0b367e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:47.063370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.064358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.065220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:47.065220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:47.065220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:47.065220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:47.069248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 323/629] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.070563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c099-3c10-42c5-8760-364d41e1225e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.070850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c099-3c10-42c5-8760-364d41e1225e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.071128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c099-3c10-42c5-8760-364d41e1225e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.073481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 324/630] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:47.073481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c099-3c10-42c5-8760-364d41e1225e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.089609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.157464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910112-e2e4-4ce2-86e7-c8272fa2b546 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.183079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c099-3c10-42c5-8760-364d41e1225e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.195439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.196136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.196423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.196700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.197420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:47.197724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.199152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.216236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 307/631] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:47.216236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.231160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.231837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.232148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.232435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.233282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:47.233478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.234905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96b014-3f38-4381-99cf-dd7580db5b8a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.244243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 325/632] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:47.245340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.245627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.245903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.263351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:47.264578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:47.293467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.341166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf2f3-9dd2-4883-bfdb-0642bed67f27 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.343728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 326/633] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:47.344614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.365281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.377056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.377709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.377992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.378268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.378983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:47.379285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.380695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.393087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 308/634] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:47.396973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.460905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688519b-9afc-4c18-8ef5-ec9786a4c716 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.496644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.497412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.497701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.497822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769310-ae20-46b6-9fcd-ebcadcb4959b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.497975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.504898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.506360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-9ffd85e2-8147-433d-8daa-434a3181c614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:47.520783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.521799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 327/635] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1f2a-37c5-4178-901c-d11d32e8b667 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.523123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1f2a-37c5-4178-901c-d11d32e8b667 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.523842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1f2a-37c5-4178-901c-d11d32e8b667 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.524655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 328/636] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:47.525349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c1f2a-37c5-4178-901c-d11d32e8b667 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.527331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.536966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.538311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.538586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.539177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.550612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.552113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:47.570149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.571579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 309/637] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.572506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.597324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.634805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c1f2a-37c5-4178-901c-d11d32e8b667 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.669163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.669955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.670243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.670518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.673946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a589f8-d187-4a34-8b42-5a72bbe3c5c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.681152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:47.688928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.690004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 329/638] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.696829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.710311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.711101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.711375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.711646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.718535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.719987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-3be72ecb-008f-49c8-8c43-53967d424928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:47.734734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:47.735905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 310/639] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:47.737537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.738219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.738219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.755846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:47.757642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:47.786900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.798500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426038-1198-4fdb-9789-c24e8efd14ff None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.824832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:47.825803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 311/640] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:47.827029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.840391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.841378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.841969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.842488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.843520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:47.844045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.845804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.859110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 330/641] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:47.860363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.932809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95f97-9fb7-484e-86d4-80de808d3096 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.963121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33429b-1376-4f67-9ed1-e72e87a4bb02 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:47.967972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.968670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.968955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.969231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:47.969954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:47.970261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:47.971661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:47.984364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 312/642] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:47.985196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:47.998458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:47.999123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:47.999591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:47.999860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.000635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.000938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.002315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.010672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 331/643] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.011407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.014726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.060196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.090528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7215dd-31b2-4ccf-9eba-16f8360501ac None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.114673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e219b1e-6496-4daf-91f6-b11172a3dce0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.125024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.125681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.125969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.126240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.127026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.127336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.128812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.141390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 313/644] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.142235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.149930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.150735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.151015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.151289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.161859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:48.170221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:48.171352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 332/645] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:48.172861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.238493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.250560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05bd2-c288-41fd-a2c9-19984aa3d0a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.278102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372b93-6cb2-4448-8bd2-d77d261c2b07 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.286426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.287070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.287320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.287419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.287601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.289114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.289306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.291011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.297146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 314/646] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.297945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.314709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.315547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.315827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.316131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.325061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.326599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:48.342751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:48.343981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 333/647] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:48.345486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.436572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159891-d342-4ce9-8568-46ea08679bac None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.464219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ce53-9091-4297-8506-11acbee5245b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.481347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.482146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.482428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.482699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.494216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.495681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.506177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.506969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.507855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.507855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/b8263daa298542be9a90840f5417e1f9/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:48.515716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:48.516691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:48.517581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:48.517581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:48.517581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:48.517581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:48.517581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 315/648] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:48.518854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.526830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.529630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=b8263daa298542be9a90840f5417e1f9, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.535163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.551271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 334/649] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:15:48 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/b8263daa298542be9a90840f5417e1f9/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:15:48.551942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.591336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.658825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd16e0-9901-4ea0-9137-2ad505a97581 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.691539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dd0a1-6979-42d4-8669-2ace6b1f2682 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.702624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.703565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.704131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.704595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.705585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.706133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.707802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.720303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 316/650] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.721669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.734449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.735266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.735584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.735849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.736721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.737023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.738523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.761958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 335/651] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.763212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.808305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.855524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafee087-f737-4ded-bdbb-a782864eab3c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.868701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:48.895115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.895780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.896081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.896357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.897133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:48.897435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.899062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.903196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d2d37-77e1-41cc-9826-5e4163d84c14 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:48.913668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 317/652] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:48.918909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:48.949415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:48.950748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:48.951531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:48.952303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:48.966109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:48.968509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:48.993671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:48.994610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:48.995470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:48.995470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:48.995470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:48.995470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:48.998486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 336/653] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:49.000302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.038014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e167-ae01-499b-8338-de9012eeedbe None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.065877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.084344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.085562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.085844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.086114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.138328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35df5-0072-4af1-9c3f-4b02a11b31c1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.184686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.188388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.190604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.196096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.197134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.197565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.197990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.207820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.209910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:49.226540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:49.227770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 337/654] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:49.228840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.338370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 318/655] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:49.339712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.347260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb136-d88f-4ffc-9703-c57a114568d9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.377379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.386514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.387283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.387653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.387999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.388932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:49.389311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.390870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.408208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 338/656] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:49.408852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.470304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.483050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b9e-e7c3-43ed-8259-c5fc9d791083 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.532122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.533576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.534322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.534773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.536097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:49.536933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.538960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.539409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66802da-178a-4bfa-a6a7-b0e6c3c689a1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.565071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 319/657] 10.222.0.13 () {56 vars in 1139 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:49.566880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.578561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.579510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.580217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.580217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.592219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.593849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:49.612830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:49.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:49.614641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:49.614641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:49.614641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:49.614641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:49.614641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 339/658] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:49.620197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.689611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.713048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf2e9-8caf-43b6-9cc5-5b5a641781b5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.736466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.739740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145ba13-d41b-481f-8245-2cda35663ce4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.761780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.762607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.762886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.763157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.776652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.778742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.795896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.796886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.797366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.797823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:49.798418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:49.799303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:49.800338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 320/659] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:49.800955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:49.883454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.884875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.939728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488119-f1dd-4670-a14b-c2773ddafd0f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:49.993195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:49.994037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:49.994323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:49.994601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:49.994719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:49.995335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:49.995994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:49.998000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:49.999627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 340/660] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:50.001415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.018487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 321/661] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:50.019724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.084419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.112637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51390996-dd75-464d-94eb-6724539d2915 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.151791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.152561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.152939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.153309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.154074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45adaf-8803-4672-8559-d5ba1fd06dc5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.154339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:50.154761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.156372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.176415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 341/662] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Jun 24 14:15:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:50.177584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.203811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.204713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.204996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.205444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.230361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.231918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.251897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:50.255897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:50.257209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:50.258079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:50.258079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:50.258079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:50.258079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:50.260300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 322/663] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:50.261376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.318518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288643a-336e-48e7-a755-6c1d1e302873 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.352433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.359049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.359865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.360177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.360452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.369734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.371250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:50.386893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:50.387860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:50.388790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 342/664] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:50.389741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.393773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc432-fd28-4305-8c8d-ceba011fc343 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.443384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.444694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.445459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.445981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.503242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056a5b6-b01a-4697-a341-aac324eeb66c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.523740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.527780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.529505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef831f41-9a86-4b02-a6fe-e3b3ac6ec512 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.543757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.544447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.544726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.544998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.545734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:50.546033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.547425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.568394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 343/665] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:50.568394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.599553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 323/666] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df7d0-eca5-474e-9d98-b920fd399939 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df7d0-eca5-474e-9d98-b920fd399939 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df7d0-eca5-474e-9d98-b920fd399939 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 324/667] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:50.660433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df7d0-eca5-474e-9d98-b920fd399939 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.692695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f900-2c41-4398-b14b-ba87584b03a3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.731228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.731810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.732111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.732386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.733178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:50.733485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.734954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.749132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 344/668] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:50.750164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.783014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df7d0-eca5-474e-9d98-b920fd399939 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.800301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.818547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.819899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.820215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.820493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.828234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.830863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e6a29d7f-60a0-41a6-b993-51449d5559a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:50.854767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:50.855712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:50.856909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 325/669] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:50.857393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd025-48dd-48df-bed2-771368828e6d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.857699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd025-48dd-48df-bed2-771368828e6d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.857862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd025-48dd-48df-bed2-771368828e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.874093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115d69-77b5-49a6-915f-3accf279f4b1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:50.875533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-93cdd025-48dd-48df-bed2-771368828e6d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:50.876814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-93cdd025-48dd-48df-bed2-771368828e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:50.889347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:50.909925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:50.910495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.910781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.911056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.922841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:50.924448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:50.945053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:50.946140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:50.946999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:50.946999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:50.946999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:50.946999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:50.948332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 345/670] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:50.949172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 326/671] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee22-4f49-4706-97fc-ef1a0d045375 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee22-4f49-4706-97fc-ef1a0d045375 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee22-4f49-4706-97fc-ef1a0d045375 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 327/672] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:50.958198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ee22-4f49-4706-97fc-ef1a0d045375 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.049476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.059488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ca7b-5681-4b0e-926c-82bb8f755ab4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.079727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ee22-4f49-4706-97fc-ef1a0d045375 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.094629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.095294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.095576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.095851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.096712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=4d3b4e1e918440858a0f10b8eadb4f52) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.097024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.098471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.105557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 346/673] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/role_assignments?user.id=4d3b4e1e918440858a0f10b8eadb4f52&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.106342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.132842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.133716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.134070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.134357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.135242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.135557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.137177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f301bb5-0d08-4c2a-be43-ac0632e0d2e6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.156498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 328/674] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.156498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.156498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.156498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.167636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.182058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:51.184014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:51.246771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41613e-5008-4fff-9cde-f46dbb3fd484 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.284049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 329/675] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:51.284049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.299079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.299807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.300050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.301024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.301152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.301360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.302767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.319304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 347/676] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.320725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.343806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.409480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474fde9-dc25-4b99-a99d-fdd76388612e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.446337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.447421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.447874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.448348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.451154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.455335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbd88-4388-41af-9f3d-16dcee8ef338 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.461168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:51.469395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:51.470429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:51.471369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:51.478725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 330/677] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:51.478725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.491664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.492345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.492623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.492895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.493731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=d505d66500da43eab82b746d7e7d0875) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.494029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.495466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.512064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 348/678] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/role_assignments?user.id=d505d66500da43eab82b746d7e7d0875&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.512064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.594613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b9cd-9499-4d74-8c5a-7205bba77be9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.600381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.621780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0be00-e1c7-43a5-aa34-b659291a7a26 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.633216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.634122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.634466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.634826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.647589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:51.655525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:51.656544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:51.657551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 331/679] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:51.658560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.667986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.668979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.669266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.669543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.679866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.681434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:51.697021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:51.697942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 349/680] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:51.699521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.723102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.781235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eb13e-c9b5-441f-b87f-1dd763fd1b78 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.814696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d7071-6efb-4ca5-8790-9f497aa8aad5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.825427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.826178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.826845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.827134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.828197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.828503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.830599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.842266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 332/681] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.843779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.852118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:51.852721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:51.853047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:51.853323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:51.854158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:51.854532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:51.855977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:51.862252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:51.868421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 350/682] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:51.869275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:51.968606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c965fb2-d98f-4bde-a582-f52741494a92 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:51.994793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.000785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc16c8-591f-46b3-b702-3b2c3f3cb1bc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.017721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.018617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.019000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.019402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.020374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:52.020780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.022961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.036471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 333/683] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:52.037527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.050703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.051695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.052291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.052479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.063785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.065329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:52.085793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:52.086922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:52.087998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:52.087998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:52.087998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:52.087998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:52.089620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 351/684] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:52.090524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.160581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.168084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13ed0-afbf-40f8-a0b9-194be0323f2e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.204654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.205705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.205962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.206350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.212556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02494e4-1723-4ce4-a4aa-fb56977306e7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.221312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.228051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:52.242779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:52.243859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:52.244789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:52.244789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:52.244789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:52.244789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:52.245437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 334/685] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:52.246796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.261626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.262549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.263065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.263544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.264675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=60d9764e77334bfba5bf18cdb026bd51) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:52.265161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.266834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.274233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 352/686] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/role_assignments?user.id=60d9764e77334bfba5bf18cdb026bd51&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:52.275340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.278625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.364471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe456-272e-471e-8a4e-5db9d379f58e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.420647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.421244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.421529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.421809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.422577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:52.422885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.424363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.447785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 335/687] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:52.453690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.476741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfa973-7487-4579-ba32-95e23f165040 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.499630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.523794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.524514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.524798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.525074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.525853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:52.526158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.527713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.540841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 353/688] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:52.548878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.594971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.614222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec27de-c525-4d63-a832-d3d52db788de None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.665344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.666601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.670014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.670506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.687970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.692334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.698670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6896-5645-4215-8e85-54928e07435f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:52.723252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:52.724285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:52.725806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:52.732182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 336/689] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:52.740106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.779442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.780342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.780629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.780907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.799212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.800890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:52.832798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:52.833805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:52.834765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 354/690] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:15:52.839659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:52.871699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508765-c13a-4a60-9c47-8f5b02ed6dfb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:52.921614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:52.922289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:52.922576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:52.924374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:52.924514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:52.925276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:52.925596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:52.927049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:52.976473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 337/691] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:52.996956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.008895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.051853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b27-4ea0-4072-8ec8-c513343fde53 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.092046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.092046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.092046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.092046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.092465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:53.092465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.092813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.112510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 355/692] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:53.120892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.177529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a9d0-d97a-4c37-a7fd-6d69de4f7000 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.258235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.258807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.259088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.259363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.312376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.325838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f673-aef0-4ae8-953a-9430292db03e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.384226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.386708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218959a-c697-4972-9e41-f8763b6a3800 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.398026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.410824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.411482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.411762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.412046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.508408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.509785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5df26-586a-4a3c-a0b5-a6b29e9c5c57 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.511636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 338/693] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:53.513981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1818-014e-4c20-baa0-56ecfcaea2fa None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.514266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1818-014e-4c20-baa0-56ecfcaea2fa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.514541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1818-014e-4c20-baa0-56ecfcaea2fa None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.520238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 339/694] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:53.521324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1818-014e-4c20-baa0-56ecfcaea2fa None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.634786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.642277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1818-014e-4c20-baa0-56ecfcaea2fa None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.653644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.655954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 356/695] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:15:53.657780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.658448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.658933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.682783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.683554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:53.683665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.683826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.684129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.685606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:53.695809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.697452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:53.716198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:53.717130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:53.718179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:53.718179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:53.718179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:53.718179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:53.718179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 340/696] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:53.718887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.771702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 357/697] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:53.773094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.853268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85c64-490f-46dd-8a1d-31b219f66cb7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.885404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e6d0-bb70-47fc-be45-1ce8034dc821 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:53.890731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.891513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.891792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.892096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.902655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.904581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.910617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:53.922764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-77f43fa9-24eb-4c13-977d-c29da33a7226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:53.923147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:53.924006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:53.925201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:53.925201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:53.925201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:53.925201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:53.925419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.925419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.925419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.925419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:53.925419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:53.926543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:53.928853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 341/698] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:53.930223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd36e0-bea2-4a45-856b-4bf752b94136 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:53.930418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd36e0-bea2-4a45-856b-4bf752b94136 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:53.930695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd36e0-bea2-4a45-856b-4bf752b94136 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:53.932050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 342/699] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:53.932772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd36e0-bea2-4a45-856b-4bf752b94136 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.940394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 358/700] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:53.941275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:53.950196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.046364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf594e-f35a-4b8b-8055-6ae7ffae8797 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.046690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd36e0-bea2-4a45-856b-4bf752b94136 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.082583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.083361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.083639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.083912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.085800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.086463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.086743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.087013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.087722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:54.088051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.089424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaa1c-3e51-400f-8fee-61030d70a988 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.095593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.097049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.107112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 359/701] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:54.107112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.107112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.107112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:54.119787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:54.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:54.121792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:54.121792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:54.121792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:54.121792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:54.121792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 343/702] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:54.122668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.123882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:54.125196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:54.172786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.193507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.208050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 360/703] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:54.208050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.243748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406b05-8f73-4c5f-bce8-9310271e0a1f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.280703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.281611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.281891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.282167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.289835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.291285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:54.306578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:54.307497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:54.308398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 344/704] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:54.308890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.325639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb4a0-68bc-4eac-afa2-368a83190378 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.365163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.366113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.366456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.366798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.373776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.375542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:15:54.391147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:54.392271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 361/705] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:54.393150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.416957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e850-6f51-4fb3-ad64-48ea98f4312a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.432415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.445713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.458391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.459282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.459703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.460072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.460860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:54.461341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.462954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.481526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 345/706] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:54.482365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.501372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7a71-bd23-42ef-925d-f99f227b80b5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.536634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.538099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.538497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.538794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] PATH_INFO: `/v3/services/network` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.539428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.540849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:54.554614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:54.555648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:54.556522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 362/707] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:54.557380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.602376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054f98-4425-424f-bed7-295b6aa82a45 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.639619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.640474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.641022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.641022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.641782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:54.642084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.643525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.658311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 346/708] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:54.659715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.663243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.668670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c152790-b4b5-43e5-bd63-383e6f590804 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.708122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.708775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.709055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.709870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.710589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.710700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:54.710943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.712420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.724567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 363/709] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:54.725935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.777121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4639-98af-4292-a89b-a303a04e490e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.810104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.810687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.810977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.811254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.811949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.813508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.822982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8b5b-60c5-4d09-a3c7-fac6e3e41718 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.832977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 347/710] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:15:54 2022] POST /identity/v3/users => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:54.833925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.863052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.863748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.864051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.864317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.865239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] RBAC: Adding query filter params (name=network) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:54.866135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:54.867563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8d49a-f0d2-4e33-8669-396e34f49187 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:54.873130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 364/711] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:54.879160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6b00-f2fe-4945-b46d-2db02112dffc None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.879481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6b00-f2fe-4945-b46d-2db02112dffc None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:54.879730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6b00-f2fe-4945-b46d-2db02112dffc None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:54.881234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 365/712] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:54.882504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6b00-f2fe-4945-b46d-2db02112dffc None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:54.908451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.948363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:54.953942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152e53-2ea9-423c-9b45-6829c5d0c67b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.999124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:54.999124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:54.999401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6b00-f2fe-4945-b46d-2db02112dffc None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:54.999669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.000001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.002368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:55.002368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.002797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.009185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 348/713] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:55.010207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:55.044958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:55.046686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.046967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.047243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.049072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=b8263daa298542be9a90840f5417e1f9) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:55.049072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.049923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0461e-166d-4080-a4be-88791b4c8eaf None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.060069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 366/714] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:15:54 2022] GET /identity/v3/role_assignments?user.id=b8263daa298542be9a90840f5417e1f9&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:55.060069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.060069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.060069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.083115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:55.085139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:55.150577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3207c1-f907-4603-9132-2299d9f9b81a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:55.198511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 367/715] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:55.208416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:55.209309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.209706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.210089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.211307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] RBAC: Adding query filter params (type=network) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:55.211761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.214194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.222120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 349/716] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:15:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:55.225910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:55.248609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:55.347985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45aab5-ef49-48a1-b4da-0e830230ada4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:55.389770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:55.390951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.391568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.392329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.393372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.395008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:55.409157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:55.410116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:15:55.410941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:55.414253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 368/717] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Jun 24 14:15:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:55.420259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:55.457810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:55.539158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd72d-5713-40c2-85e0-3cdeeb713099 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:55.574576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:55.575240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.575519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.575787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.576531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:55.576833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.578219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806248a-e4ec-42f4-8b6a-d58a2f80c824 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.583363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 350/718] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:15:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:55.589494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:55.700754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:55.728468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113669-b2fd-489b-9ec5-83ff81cb22d6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:55.772336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:55.773007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:55.773289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:55.773568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:55.774281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:55.774589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:55.775970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d86aa-b6cf-4ce5-90eb-3a249b68d73c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:55.785159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 369/719] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:15:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:57.324930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcef76-2769-4160-a208-99e7a5507247 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.325436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcef76-2769-4160-a208-99e7a5507247 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.325547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcef76-2769-4160-a208-99e7a5507247 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.327042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 351/720] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:57.332382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50dec-532f-4c14-a5f7-0451e2982157 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.332780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50dec-532f-4c14-a5f7-0451e2982157 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.332965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50dec-532f-4c14-a5f7-0451e2982157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.360233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e2a50dec-532f-4c14-a5f7-0451e2982157 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:57.361413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e2a50dec-532f-4c14-a5f7-0451e2982157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:57.462918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 370/721] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:57.513841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcef76-2769-4160-a208-99e7a5507247 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:57.631644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:57.642748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcef76-2769-4160-a208-99e7a5507247 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:57.670548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e98-9ae7-48e4-b4fa-7f40b5538dd9 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.670856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e98-9ae7-48e4-b4fa-7f40b5538dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.671115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e98-9ae7-48e4-b4fa-7f40b5538dd9 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.672791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 371/722] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:57.678504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2226c-c599-4a19-b6c9-2b90550060d4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.678791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2226c-c599-4a19-b6c9-2b90550060d4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.679125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2226c-c599-4a19-b6c9-2b90550060d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.691159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:57.693834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.694339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.694621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.709764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-eff2226c-c599-4a19-b6c9-2b90550060d4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:57.710969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-eff2226c-c599-4a19-b6c9-2b90550060d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:57.719373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:57.727499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:57.728452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:15:57.729281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:57.742374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 352/723] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:57.762335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:57.842207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 372/724] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:15:57.844286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15760-b6e7-4914-8f84-d197170a411a None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.844900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15760-b6e7-4914-8f84-d197170a411a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.845351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15760-b6e7-4914-8f84-d197170a411a None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.847665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 373/725] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:57.854467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.854754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.855044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.871646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:57.888006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:57.889614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:57.916141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb10cb8-4f9e-40dd-92de-e59ab2d3d71f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:57.952396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:57.953060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.953342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.953618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.954365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:57.954670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:57.956056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d226-f292-4d28-ad30-5fe071a66206 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:57.962036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 374/726] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:57.962637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:57.967137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 353/727] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:15:57.968995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2713028-c4dd-419f-8245-d14aa2ce1996 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:57.969518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2713028-c4dd-419f-8245-d14aa2ce1996 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:57.969989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2713028-c4dd-419f-8245-d14aa2ce1996 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:57.971511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 354/728] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:57.972484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2713028-c4dd-419f-8245-d14aa2ce1996 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:57.992446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.087212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2713028-c4dd-419f-8245-d14aa2ce1996 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.100731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1d789-b4ce-4def-9030-066f0aadc853 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.124718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.125501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.125777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.126049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.138084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.139128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.139749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.140118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.140401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.140672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.143021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.153576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4601ced7-6857-422a-b919-2e8d8415e7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:58.158991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:58.159919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:58.168412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:58.168412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:58.168412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:58.168412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:58.168412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 355/729] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:58.168699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:58.169541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:58.170365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:58.170994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.170994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.170994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.171169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 375/730] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:58.171169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.186705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:58.187920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:58.257765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.266694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 356/731] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:58.267642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.292734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf05d6-b49e-4de4-b778-0d87dd84515e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.333211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.335014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.335708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.336188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.337257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.339433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.360201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 376/732] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:15:58 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:58.360201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.397208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21deb4-d34f-4190-a2bb-eb611fa4dbab None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.433182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.473160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.474011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.474011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.474011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.476758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:58.476758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.478111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.494428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 357/733] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:58.495928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.510907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2619b8-0f9e-4cb9-8b99-37eb62ffb17f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.551683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.552485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.553298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.553576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.554334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:58.554644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.556237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.556357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.569523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 377/734] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:58.570389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.621946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350040-a3d9-4e3a-bf25-8b211b9e3db0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.666644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.668828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.669985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.670372 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.685798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:15:58.691783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd7b3-7b9c-4eb7-8769-276990038354 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-35822386-8ca6-4402-8bb1-015f1321baac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:15:58.695832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:58.696857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:15:58.697709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:58.698343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 358/735] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:58.699599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a9ee-5112-4942-b929-032520daaf13 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.699959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a9ee-5112-4942-b929-032520daaf13 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.700394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a9ee-5112-4942-b929-032520daaf13 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.702502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 359/736] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:15:58.702930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a9ee-5112-4942-b929-032520daaf13 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.718493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.739021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.739945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.740149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.741073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.750451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.751933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:58.769816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:58.770846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:15:58.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:58.775619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 378/737] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:58.776667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:58.836581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a9ee-5112-4942-b929-032520daaf13 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.851373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:58.876874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.877576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.877858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.878128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.891401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.892891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-be6cd717-fddc-4ac7-b029-d334e4b1a63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:58.910495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:58.911458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:58.912897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:58.912897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:58.912897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:58.912897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:58.912897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 360/738] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:58.913547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.913673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.913954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.915053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a706e4-9690-4324-b111-ef0a31cc56f5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:58.931396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:15:58.932624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:15:58.954879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:58.955781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:58.956092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:58.956364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:58.957101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:58.957400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:58.958866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:58.967608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 379/739] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:58.968427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.004694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 361/740] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:15:58 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:15:59.006086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.023347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.091209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6508c-ee81-4e5a-8ef8-bff4c7f38b4a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.127487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.133722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.134396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.134677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.134953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.135240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c246ba-d176-4797-ae7f-2c5ace2f6fb1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.135795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:59.136132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.137566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.160341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 380/741] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:15:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:59.160341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.175462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.176229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.176582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.176949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.177670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:59.178609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.179993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.196074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 362/742] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:59.196074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.280269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.291590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b3967-0ea3-4855-b4aa-e0c7b1391c73 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.309539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aae59-e5a1-480b-a9e6-7d8ea70e088f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.330553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.331335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.331609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.331963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.342646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.344104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.345748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.346626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.346732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.346936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.347653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.349046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:15:59.366018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:59.366967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 381/743] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:59.372728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.373076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 363/744] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:15:59 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:15:59.373076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.402801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.497058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f0c1-018f-4d2c-86cf-75d3b5a6c236 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.539364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc0418-e936-4786-94b1-237e673695f8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.542310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.542968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.543245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.543537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.566978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.587399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.588228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.588510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.588784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.597341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.598808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:15:59.614038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:15:59.615003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:15:59.616465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 364/745] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:15:59.620526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.635358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.637311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.708095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.744199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 382/746] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:15:59.748244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33e315-c4f9-4145-aa66-83ff05ac700f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.749361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.789669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.790376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.790664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.790936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.791664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:59.791969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.793854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.804493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:15:59.812108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 365/747] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:59.813193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.864537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c93dea-4dc7-4c6a-952d-b6fc3b684cb8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.902263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:15:59.903277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:15:59.903774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:15:59.904261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:15:59.905313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:15:59.905812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:15:59.907499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:15:59.926250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 383/748] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:15:59.927428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:15:59.948190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe8b20-0288-4627-8a2f-8fe5d40fa9a7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:15:59.992448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.003880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.004681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.004956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.005222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.017569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.019040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:00.036683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:00.037630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:00.038519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:00.038519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:00.038519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:00.038519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:00.042533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 366/749] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:00.043411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.051763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d092f-4848-40a9-81ba-bce8feec0b9c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.063158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.101165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.102874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.103609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.104114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.117101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.119826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:00.141100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:00.142094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:00.143025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:00.146008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 384/750] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:15:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:00.147088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.171134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dacb6-f30b-4db1-b66b-36787bcdcf91 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.211081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99534-f237-4115-8af1-b786103990ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.212171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99534-f237-4115-8af1-b786103990ad None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.212708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99534-f237-4115-8af1-b786103990ad None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.213173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99534-f237-4115-8af1-b786103990ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.224551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f99534-f237-4115-8af1-b786103990ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.226777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f99534-f237-4115-8af1-b786103990ad None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-97f99534-f237-4115-8af1-b786103990ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:00.245233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:00.246186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:00.247057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:00.247057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:00.247057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:00.247057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:00.251293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 367/751] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:00.252258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99534-f237-4115-8af1-b786103990ad None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.265041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6198b-f638-4daf-9887-438d11c19aa9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.288334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.301485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.302145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.302424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.302714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.303556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:00.303761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.305239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.322398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 385/752] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:00.323286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.353863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.362718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99534-f237-4115-8af1-b786103990ad None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.400390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.401370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.401800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.402223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.403206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:00.404190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.405926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.424617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 368/753] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:00.425685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.438277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95280280-998d-46a7-8d3b-b46e6abdb1de None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.483092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.483928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.484622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.484908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.485791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:00.486107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.487504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.502378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 386/754] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:00.503135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.540362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.551723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a5e49-8a18-4b67-9ba4-bda59c871fd1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.590705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.591492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.591771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.592060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.599391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.601187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.604222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e4480a74-97b2-44f4-9af1-ac851f5a3fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:00.614919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:00.616662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:00.617556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 369/755] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:00.618590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3742-befe-4873-b61c-348d88b9d30e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.618590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3742-befe-4873-b61c-348d88b9d30e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.618747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c3742-befe-4873-b61c-348d88b9d30e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.620232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 370/756] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:00.624693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c3742-befe-4873-b61c-348d88b9d30e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.626825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6289-0350-4d05-9f58-41fb813efccc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.664007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.665165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.665165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.665361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.736440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c3742-befe-4873-b61c-348d88b9d30e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.740795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.742377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aeac2-ef50-4ccb-aa37-a5a817204dd2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.773920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.774623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.774899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.775170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.782300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.783741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:00.798036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:00.801705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 371/757] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:00.802595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.819431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.839619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:00.861213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 387/758] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:00.861213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.861213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.861213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.875143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:00.876455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:00.917504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb59b-5789-47b2-9a3c-463d3be1e24e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:00.950367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 388/759] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:00.951219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:00.963264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:00.964208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:00.964669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:00.965103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:00.966143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:00.966648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:00.968449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:00.982868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 372/760] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:00.984170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.065681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f845033-b21e-447b-88ff-f2f0ee3ea002 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.068577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.084277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.100376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23ae1-e47e-4c07-951f-00774b506a93 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.104290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.104950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.105227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.105501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.106284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:01.106592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.108206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.120906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 389/761] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:01.121709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.140524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.141311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.141610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.141862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.152996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.154639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:01.172299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:01.173241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:01.174171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:01.174171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:01.174171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:01.174171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:01.174171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 373/762] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:01.174444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.239581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6a02-c5bd-46ee-8a0b-98b91d1ca2e5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.274686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.275485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.275768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.276066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] PATH_INFO: `/v3/services/network` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.276727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.278109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.285215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c46fc-854a-4f78-bd05-3d446aee648b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:01.291886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:01.293119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:01.293982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 390/763] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:01.294766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.317956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.330867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.331707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.332201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.332487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.333317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=00ad856d9989434f871d7facb6b69a8a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:01.333626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.335087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.341023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 374/764] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/role_assignments?user.id=00ad856d9989434f871d7facb6b69a8a&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:01.341642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.359065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.443592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4e7a-dca7-471f-86b0-59497df80f01 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.482256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d995f2-258f-4f4b-b715-1f11bfb617e3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.492600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.493827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.494283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.494724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.497084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=0e00c4684e0645eaa796aa1765f7481e, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.498790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.523003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 391/765] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:01 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:01.524761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.528378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.529341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.529860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.530216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.531267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:01.531712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.533217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d235-9c84-4b2e-857a-f73460e02e66 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.547154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 375/766] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:01.549688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921cfa-08ea-44ae-bbaa-5484e44072df None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.550668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921cfa-08ea-44ae-bbaa-5484e44072df None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.551672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921cfa-08ea-44ae-bbaa-5484e44072df None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.554262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 376/767] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:01.556126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921cfa-08ea-44ae-bbaa-5484e44072df None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.625481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.677397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.682109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59f99a-7dc0-4785-a260-e80ed6d22d46 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.707063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921cfa-08ea-44ae-bbaa-5484e44072df None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.732255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.733444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.733931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.734453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.735384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] RBAC: Adding query filter params (name=network) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:01.735897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.737591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879660-0c5c-4d44-91a9-86ed133bb05c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.747949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 392/768] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:01.749619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.749619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.749619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.754511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.756397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.756718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.756993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.768137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.771319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:01.773042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:01.774224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:01.799653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:01.801365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:01.803866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:01.807763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 377/769] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:01.809484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.862847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 393/770] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:01.863705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:01.945157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34355f-2538-4ab5-b6ed-be85b2751903 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:01.955990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:01.991885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:01.993588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:01.994310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:01.995035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:01.996852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:01.997724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:01.999474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:02.002110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.006474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb40d5-1b15-4a12-9766-d0fcc4b7183f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.020156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 378/771] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.022509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.045314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.045989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.046272 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.046547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.047338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.047646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.049711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.065988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 394/772] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.067177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.146991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e861-3572-4595-819a-4e219ce57c40 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.187535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.188796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.189282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.189551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fd0f2-6299-4a29-a84e-fd2ff2902aec None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.190082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.191010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.192634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:02.208589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:02.209688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:02.210520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:02.224799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.225337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 379/773] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:02.225466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.225733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.226277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.227069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] RBAC: Adding query filter params (interface=public, service_id=c6c090bb8f5f410a874f177e81d16f64, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.227376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.227623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.228942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.236892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 395/774] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/endpoints?service_id=c6c090bb8f5f410a874f177e81d16f64&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.240675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.276896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:02.283110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:02.365634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ff38-be7a-4166-82d3-11a6c6bda1ea None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.366175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216d93-f315-4df5-8d86-1a2513a66402 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.404861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.406021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.406473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.406916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.407775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.408259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.409002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.409757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.410137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.410307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.410598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.411548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=b8263daa298542be9a90840f5417e1f9) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.412651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.414378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.417149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 396/775] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.418123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.423328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 380/776] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/role_assignments?user.id=b8263daa298542be9a90840f5417e1f9&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.424872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.520942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:02.543970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c53d1-d140-4ed4-9ee9-62fd4cbc778e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.544839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:02.554365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbbba-e062-4092-8000-d7c44a3bc285 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.584340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.585530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.586006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.586472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.587504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.589205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.598226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 397/777] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.623738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.624474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.624779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.625018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.625750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.626054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.627465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.642042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 381/778] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.648361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.826756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890050-58e5-4ec3-98b0-f53f9ecddc96 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:02.871531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:02.872224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:02.872502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:02.872773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:02.873565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] RBAC: Adding query filter params (interface=public, service_id=efb5cd9708714bce8e5a7383bdb7da68, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:02.873871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:02.875780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2fe0a-aeb0-484e-965f-b816ff2fc7ad None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:02.882952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 398/779] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/endpoints?service_id=efb5cd9708714bce8e5a7383bdb7da68&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:02.888456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:02.999503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931807-2f04-4b6e-8420-f28faa593730 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:03.037005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:03.038346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:03.038627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:03.038998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:03.040220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:03.041891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d822f-5218-4a84-b534-68643b9dbc75 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:03.047925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 382/780] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:02 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:03.767941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b02e9-b640-4118-a473-65ec987ff8c6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:03.769010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b02e9-b640-4118-a473-65ec987ff8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:03.769499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b02e9-b640-4118-a473-65ec987ff8c6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:03.771871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 399/781] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:03.776814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:03.777643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:03.778125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:03.798581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:03.800143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:03.817088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb892-1974-4deb-b71c-0baf639644e0 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:03.817426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb892-1974-4deb-b71c-0baf639644e0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:03.817652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb892-1974-4deb-b71c-0baf639644e0 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:03.819330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 400/782] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:03.824286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:03.824675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:03.825097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:03.830656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:03.856144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:03.857331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:03.867850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:03.919037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 383/783] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:03.945868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:03.974239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 401/784] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:04.012857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.049616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18e95-bf6f-44ff-91d4-abe3471bd393 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.085617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.086413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.086694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.086968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.097929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:04.106623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:04.107572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:04.108515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 384/785] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:04.113595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.137540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:04.208422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775f7a-3017-46fd-af70-e3e8bb970215 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.219248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abf32-56a1-4024-9354-7e7d711e90b4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.257515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.258185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.258468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.258752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.259507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:04.259817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:04.261299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:04.262960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.263922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.264369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.264810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.270426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 385/786] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:04.280069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.283893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:04.291554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:04.305736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:04.306848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:04.307702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 402/787] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:04.316905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.370998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:04.405985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f342e-6671-4e95-9aa4-b16faf41c743 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.477322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.478121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.478565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.478848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.492960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f53ed-67b3-46b6-932d-9a66bd9f02ef None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.497079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:04.504976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:04.538103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:04.539314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:04.540235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:04.540235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:04.540235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:04.540235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:04.541787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 386/788] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:04.547722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.564390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.565068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.565351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.565625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.566396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:04.566704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:04.568168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:04.586595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 403/789] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:04.592195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.677009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:04.744681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c571-5e0a-48d4-8cdc-5050e633c854 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.776264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1742b2-9591-4c48-959b-e563978c90a2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:04.813578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.814993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.815421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.815916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.855475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:04.857321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:04.858049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:04.863920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:04.866145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:04.866958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:04.867790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:04.869501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:04.870347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:04.872181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:04.892921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 387/790] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:04.901890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:04.915919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:04.916892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:04.917756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:04.917756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:04.917756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:04.917756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:04.927286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 404/791] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:04.931527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:05.142093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df629a6-f48a-4525-b22c-bdae97669a64 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.151393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb46733-5774-4dd5-9d09-7ce2bd2ea3a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.164422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:05.225772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.227060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.227606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.228096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.231099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:05.231639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.233966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.251684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.252924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.253296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.253807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.276196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 405/792] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:05.281158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:05.284438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.287837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-23e7582b-6cc0-4c5a-8fe8-b6eb4e5df4e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:05.324770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:05.325893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:05.326821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 388/793] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:16:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:05.328129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955986a-6a67-4ffc-8475-028bab954092 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.328410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955986a-6a67-4ffc-8475-028bab954092 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.331151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955986a-6a67-4ffc-8475-028bab954092 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.331151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 389/794] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:05.332133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955986a-6a67-4ffc-8475-028bab954092 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:05.418612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:05.426588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd356-6bfa-4bb6-b376-ac1354e3f1d4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.469937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.471361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.472230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.473013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.475572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955986a-6a67-4ffc-8475-028bab954092 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.481689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.483179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-6dc97d03-e4cb-44ce-8959-01da43938774 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:05.502282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:05.503262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:05.504216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 406/795] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:16:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:05.504802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.506217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.506217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.519666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.520371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.520643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.520973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.522441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:05.522745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.523013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:05.524194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230a5c-9cd9-4580-9a94-7c5cd8f6377f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.524292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:05.547999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 390/796] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:16:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:05.547999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7005-c8f5-45de-a945-2113c5730db2 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.547999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7005-c8f5-45de-a945-2113c5730db2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.547999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7005-c8f5-45de-a945-2113c5730db2 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.548400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 391/797] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:05.549063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7005-c8f5-45de-a945-2113c5730db2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:05.555842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:05.612066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 407/798] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:05.612066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:05.691492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7005-c8f5-45de-a945-2113c5730db2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.703802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:05.729552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3220af-f0d9-464c-aaec-08e2987ea7a4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:05.729906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.730890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.731397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.731956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.733918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:05.734387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.737205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc4e02-d6bc-4b55-8d06-753468908f3e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.774400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38d150-821f-49f5-8005-096f568c748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:05.774682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 392/799] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:16:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:05.775099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d150-821f-49f5-8005-096f568c748c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.775380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d150-821f-49f5-8005-096f568c748c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.775655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d150-821f-49f5-8005-096f568c748c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.776668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:05.777154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:05.777633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:05.806812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:05.808306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:05.820974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:05.871062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38d150-821f-49f5-8005-096f568c748c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:05.872708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38d150-821f-49f5-8005-096f568c748c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:05.922121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 393/800] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:05.923226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.003030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 408/801] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:06.004395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48b8a-983b-4f71-8232-da4a7954a440 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.004683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48b8a-983b-4f71-8232-da4a7954a440 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.004957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48b8a-983b-4f71-8232-da4a7954a440 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.008713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 409/802] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:06.008713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48b8a-983b-4f71-8232-da4a7954a440 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.065569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.069966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b4406-d802-429d-98bf-95ee13d0645e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.075199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.108129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.108922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.109201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.109474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.118656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48b8a-983b-4f71-8232-da4a7954a440 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.120069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:06.127811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.128967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:06.129817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:06.132177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 394/803] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.133290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.154074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.154879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.155151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.155426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.166307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.167785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:06.187348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.188368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.189260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:06.189260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:06.189260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.189260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:06.189260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 410/804] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.189546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.244749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a117dd-9235-4484-a505-7f148bc19bca None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.282906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.283711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.283985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.284286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] PATH_INFO: `/v3/services/network` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.284937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.286323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.294410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423b35-6ab8-4e7a-8945-e8b728016800 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-97cdb3e4-806b-42e0-834c-f94df1a67e5c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.298900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.299988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:06.300859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 395/805] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.301627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.302101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.302207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.315050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.319971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:06.321188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:06.334172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.334954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.335231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.335507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.337979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.345962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.347416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:06.370168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.371611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 411/806] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.372560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.398496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 396/807] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:06.399157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.487805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451aa0f-3b21-4968-91c2-a8447a54e703 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.513956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070770fb-2571-4d54-b2f0-ba43384225be None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.525224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.525960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.526245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.526640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.527374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:06.527715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.529078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.538585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 412/808] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:06.539372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.553394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.554155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.554481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.554757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.555486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:06.555783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.557178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.570179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 397/809] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:06.571064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.576399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.587402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.661275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74889cf-f5d3-4a62-a6e3-4319a33f7a95 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.680819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2887d9e-4458-4f24-adbd-ad62eb0e8639 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.697396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.698049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.698326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.698600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.699297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] RBAC: Adding query filter params (name=network) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:06.699603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.701043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.706275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 413/810] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:06.707083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.718070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.718724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.719272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.719272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.720199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:06.721971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.721971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.734909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 398/811] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:06.735735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.813707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.825594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:06.834927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1acc-78b4-4938-9766-2672e137e835 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.850033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e28c2-9abd-4e1e-b542-4d674ce120c3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:06.871523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.872352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.872631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.872901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.873714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.875118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.887871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.888906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:06.889742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 414/812] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.890576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.891756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:06.892632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:06.892924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:06.893314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:06.905524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:06.907172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:06.926349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:06.928630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 399/813] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:06.929931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:06.999523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9c35-2d91-42ee-b94d-eaab90b8115f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.034593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.035393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.035671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.035944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.039149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f4c-a4cf-46f0-8678-999e3a2a7de7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.042940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.044423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:07.058940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:07.059961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:07.060885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 415/814] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:07.061363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.067101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.079026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.079687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.079967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.080268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.080866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.080999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.081266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.082842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.088742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 400/815] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.089823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.169506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c99fd-5aab-482b-bbea-cd75dd2dc6b9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.201902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb52d-7636-4d43-85ba-9eb596e038a5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.211207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.212009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.212317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.212591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.225395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.227231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:07.242002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:07.242945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:07.243837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 416/816] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:07.244368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.251230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.251885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.252199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.252471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.253173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.253470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.254835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.263863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 401/817] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.263863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.324790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.350172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6004ab7-bf64-4bb4-9c46-b28286223400 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.388446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.389123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.389407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.389681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.390411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.390716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.392164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.405318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 417/818] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.406152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.431329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.478568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43f45f-e7b4-4705-b09d-3c6e2e8398aa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.505158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f4c9-912c-4e60-a59c-7421ddb1bbf9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.512793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.513451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.513733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.514008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.514793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.515097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.516585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.534744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 402/819] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.535589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.544898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.545553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.545833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.546106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.546836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.548232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.556127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.569381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 418/820] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:07.570308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.651519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871a291-befd-4e6e-9991-a2269b3b5e7a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.670986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.704500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e19f8-b1a5-4a9e-ae35-a7aa7602dcdc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.710585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.711345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.711693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.712051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.712960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.713345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.714858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.728660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 403/821] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.729530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.749918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.750605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.750881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.751150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.751861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:07.752199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.753601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.759692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 419/822] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:07.760691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.844353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.875993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3f07-e9e1-4cc8-bcc7-011e2d18ee9a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.894321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a984b-d034-4735-899b-2ddc5cb675b6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:07.911328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.912081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.912362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.912632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.920065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.921495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.929701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:07.930573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:07.930852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:07.931124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/00ad856d9989434f871d7facb6b69a8a/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:07.935087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:07.936487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 404/823] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:07.937441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:07.967804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:07.971410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=00ad856d9989434f871d7facb6b69a8a, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:07.972890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:07.986781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 420/824] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:07 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/00ad856d9989434f871d7facb6b69a8a/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:07.987719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.078895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aa848-f3bb-489f-aaf3-ad744bba65e0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.111501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b14c-f10e-44fc-8d0d-46b6cf038e7a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.114028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:08.122484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.123157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.123469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.123711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.124601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:08.124913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.126387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.133800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 405/825] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:07 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:08.142159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.164390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.165305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.165806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.166294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.167280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.168934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.190487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 421/826] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:08.266222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:08.282143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ddabf-9e9d-4dd0-bb98-8260fd2e5b4e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.329691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.330643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.331096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.331517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.332654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:08.333132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.334828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.356917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 406/827] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:16:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:08.362703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.479467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41afd-5e5c-4dad-83af-7133874b0df7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.517330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.518303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.518690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.519070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.531099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.532745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:08.550975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:08.552095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:08.553737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:08.553737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:08.553737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:08.553737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:08.555339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 422/828] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:08.560764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.664942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dffd1-7ba1-4163-b36b-5f458b030288 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.702518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.703418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.703874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.704319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.705175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:08.705621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.707146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.726411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 407/829] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:08.732198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.748992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:08.841476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f5f1-73f2-4b9c-9e8b-237308084ef7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:08.876886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:08.877697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:08.878008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:08.878288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:08.885286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:08.886816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:08.901649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:08.902586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:08.903476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 423/830] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:08.910105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:08.920933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:09.014699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944fd-a4d4-4170-a2c3-43ddaae4725d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:09.051714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:09.052848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:09.053382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:09.053854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:09.054830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:09.055349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:09.056996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e67228-e073-44ac-ac4e-6dd3e0dbef9d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:09.069774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 408/831] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:09.075753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:09.152775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:09.185828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895faeb0-18dc-4d1a-b14b-b2c18cf36e51 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:09.221369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:09.222048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:09.222332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:09.222612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/b8263daa298542be9a90840f5417e1f9/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:09.225186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=b8263daa298542be9a90840f5417e1f9, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:09.226895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eaf18-bce2-4ece-a99a-7d0d3e1eb921 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:09.243039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 424/832] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:09 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/b8263daa298542be9a90840f5417e1f9/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:10.154963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca18b7-bcaa-4423-ba7b-cedfa926eace None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.155524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca18b7-bcaa-4423-ba7b-cedfa926eace None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.155524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca18b7-bcaa-4423-ba7b-cedfa926eace None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.157210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 409/833] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:10.162857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be08bb-ca9e-4534-8682-1dc3f16c9550 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.163265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be08bb-ca9e-4534-8682-1dc3f16c9550 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.163436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be08bb-ca9e-4534-8682-1dc3f16c9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.180771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-29be08bb-ca9e-4534-8682-1dc3f16c9550 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:10.181954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-29be08bb-ca9e-4534-8682-1dc3f16c9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:10.253717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 425/834] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:10.277583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca18b7-bcaa-4423-ba7b-cedfa926eace None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.309188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfcb50-b7da-4eae-9874-afbd001ee2e6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.309469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfcb50-b7da-4eae-9874-afbd001ee2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.309747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfcb50-b7da-4eae-9874-afbd001ee2e6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.311390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 426/835] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:10.316442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.316724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.317000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.334492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:10.335659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:10.357088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.399109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca18b7-bcaa-4423-ba7b-cedfa926eace None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.409837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.428111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 427/836] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:10.447418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.450881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.451914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.452482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.452970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.467019 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:10.481080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:10.482056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:16:10.482874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:10.485639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 410/837] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:10.496049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.567856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b745ed-8d58-449d-83e0-c7c01e3cd17c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.607169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7859e2-4639-4d0e-a0a5-92f09b9ecd07 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.609444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.610261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.610551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.610827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.611481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:10.612938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-77f20683-aaf6-4c17-8b3d-ae3bab5e1141 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:10.625883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:10.627016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.628054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 428/838] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:10.629066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa250-dd57-49b0-b058-98a90873389a None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.629066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa250-dd57-49b0-b058-98a90873389a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.629221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa250-dd57-49b0-b058-98a90873389a None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.631049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 429/839] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:10.635903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa250-dd57-49b0-b058-98a90873389a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.639514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.651251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.652104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.652388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.653081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.653829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:10.654137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:10.655510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4b927-7e96-49e4-8e14-ef377975617a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:10.669312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 411/840] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:10.669312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.669312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.669312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.688053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:10.689529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:10.701675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.751206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa250-dd57-49b0-b058-98a90873389a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.775961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 412/841] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:10.775961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.790334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.790995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.791281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.791558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.792320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:10.792617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:10.794013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:10.799020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 430/842] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:10.799826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.888637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104ec6b-c492-442a-8620-102ac4483060 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.910070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.915256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196ed28-4898-4c21-9498-e4e5db5141a3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:10.928521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54349c40-1407-467a-add9-e7863952058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.934905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c40-1407-467a-add9-e7863952058d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.934905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c40-1407-467a-add9-e7863952058d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.934905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c40-1407-467a-add9-e7863952058d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.941864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:10.946602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54349c40-1407-467a-add9-e7863952058d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:10.948456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54349c40-1407-467a-add9-e7863952058d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:10.958315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:10.959654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:10.959935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:10.960233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:10.960881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:10.962252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-54349c40-1407-467a-add9-e7863952058d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:10.967289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:10.968407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 413/843] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:10.974023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54349c40-1407-467a-add9-e7863952058d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:10.974861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:10.976007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:10.978359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 431/844] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:10.980456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.082031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aabeb-2ae4-403e-a397-e62a32d5d57d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.082407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54349c40-1407-467a-add9-e7863952058d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.116340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.116730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.117021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.117301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.117398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.117576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.117683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.117909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.118284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:11.118584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.118676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:11.118900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.119972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.120275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.136449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 414/845] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:11.136449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.147415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 432/846] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:11.154567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.186383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.226539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.284418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b01143-1c2e-4ad7-ad85-439f5673aea1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.307627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7993-23af-442d-8473-77c5241f1021 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.332056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.332421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.332719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.333004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.333764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:11.334240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.335630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.340920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 415/847] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:11.346199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.353877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.354997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.356063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.356527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.368012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.370363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-430fe013-db78-4ecb-8f16-4f73592c5a31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:11.395578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:11.396691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:11.397647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:11.400355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 433/848] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:11.402313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02236742-3c93-4fe0-a3d3-4ed6719d3bd6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.402751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02236742-3c93-4fe0-a3d3-4ed6719d3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.404049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02236742-3c93-4fe0-a3d3-4ed6719d3bd6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.405996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 434/849] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:11.407679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02236742-3c93-4fe0-a3d3-4ed6719d3bd6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.459855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.464592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad660a-d3ef-4166-baa9-eccf956b4143 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.501262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.502092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.502375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.502651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.503354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:11.503656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.505058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd188e-8656-473d-b551-6409fc647cf5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.517600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 416/850] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:11.517600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.517600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.517600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.532603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:11.534145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:11.538652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02236742-3c93-4fe0-a3d3-4ed6719d3bd6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.543079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.594843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.596033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.596454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.597475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.598767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:11.599813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.602386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.624213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 417/851] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:11.628723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 435/852] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:11.634290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.656868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.748492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.760070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879010c-3db0-453e-9a0f-03011e77eda7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.793401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.794051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.794396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.794587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.796856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579b84-ec78-4c81-8b7b-98ec06e844cb None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:11.844956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:11.846732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:11.847197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:11.847902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:11.863161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:11.871291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:11.872887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:11.873492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:11.874397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:11.875212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:11.878718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 436/853] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:11.884698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:11.921141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.985803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:11.999089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 418/854] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:12.004289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.041203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56c55-5b54-4d08-beaa-02a4b59fc820 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.088293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.088960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.089238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.089517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.090383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:12.090692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.092206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.104055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 437/855] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:12.110262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.150684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd6f1-bebf-460a-8ff4-3235fe62af41 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.211878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.212704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.212981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.213253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.233462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.235684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.261040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:12.263190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:12.264821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:12.265927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:12.265927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:12.265927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:12.265927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:12.272045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 419/856] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:12.275509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.285822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04771f4-a91f-4b15-bf10-54accf625d38 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.323169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.324087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.324441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.324790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.337531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.339154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.340355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:12.359923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:12.361079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:12.362189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:12.362189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:12.362189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:12.362189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:12.366981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 438/857] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:12.367836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.421415 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589c1c9-be6b-4401-9481-faf7d8bd2b02 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.469870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.470756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.471421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.472295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.473441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:12.473896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.475071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84f988-7e9d-45ab-8144-15d6a2a3e890 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.475633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.492179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 420/858] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:12.497123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.517706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.518403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.518693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.518973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.519687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:12.520244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.521684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.524417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.544958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 439/859] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:12.547338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.620626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30274-6ad1-4bc2-9ed0-3d2ae9729b9b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.623738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.663850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.665387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.665904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.666381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.677096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.679662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.680248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c580c-15fa-4d6b-9be4-dd9b4dbd4201 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:12.699066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:12.699987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:12.700947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:12.705276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 421/860] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:12.706351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.728708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.730633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.731158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.731961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.744461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.747390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:12.767446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:12.768612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:16:12.769549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:12.772355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 440/861] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:12.778030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.838826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0a41-f855-4204-9db7-396459946035 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.848776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.881662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.882698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.883208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.883684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.884798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:12.885402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.887092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.904071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abacf94-0ca7-441d-b396-fb7c754fad4b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:12.905277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 422/862] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:12.906201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:12.934871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:12.941326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:12.942117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:12.942503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:12.942911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:12.943877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:12.944310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:12.945985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:12.965108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 441/863] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:12.971134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:13.027910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6e8d-f0b5-4aab-81ff-d059ade9615d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:13.073427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:13.074397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.074828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.075247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.076285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=00ad856d9989434f871d7facb6b69a8a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:13.076751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:13.078516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f4367-c9dd-420f-8ad9-5f2e18e7c37e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:13.092499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 423/864] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/role_assignments?user.id=00ad856d9989434f871d7facb6b69a8a&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:13.203333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ba23d-4671-4a2e-aa16-db2d8886e9ec None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:13.232789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:13.259273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:13.259929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.260337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.260611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.270306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae381-86f5-4560-b2e6-a4e00a45e8bc None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.270822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae381-86f5-4560-b2e6-a4e00a45e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.271439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae381-86f5-4560-b2e6-a4e00a45e8bc None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.272953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 424/865] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:13.278685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.278914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.279289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.299717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:13.300957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:13.346967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:13.348598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:13.394141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 425/866] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:13.433508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:13.466938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:13.518118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 442/867] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:13.527933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:13.556804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:13.613566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e20d9-8393-4e9d-902b-5f1d5eda7c13 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:13.675064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:13.676175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.676632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.677080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.679640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:13.682487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f681-e3bc-4d1a-8f7f-6d9d3be90d08 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:13.710379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 426/868] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:13 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:13.716877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dad81-28d3-4d78-a674-c40e0a403823 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.717487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dad81-28d3-4d78-a674-c40e0a403823 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.718106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dad81-28d3-4d78-a674-c40e0a403823 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.720061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 427/869] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:13.727304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.727716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.728159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.738365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799b83-a4db-479a-873b-84d9bbe735ea None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:13.758033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:13.760899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:13.786272 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:13.788296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:13.788740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:13.789194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:13.808253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:13.810682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:13.870165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:13.871855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:13.874258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:13.874258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:13.874258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:13.874258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:13.876538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 428/870] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:13 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:13.878115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 443/871] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:13.890485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:13.905374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:13.915239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:14.014478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:14.054638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0706-8af5-458c-bc33-9330a489dacf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:14.080109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532059-ee04-424a-81d7-e921705fa9d1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:14.111164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:14.112491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:14.113172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:14.113579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:14.116148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:14.116693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:14.119078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:14.123264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:14.124042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:14.124415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:14.124771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:14.125568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:14.127021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:14.136394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 429/872] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:14.142135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:14.156249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 444/873] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:13 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:14.237500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:14.279994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c1a89-09ac-4ac4-89c8-68e470ddefc0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:14.328196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:14.328196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:14.328196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:14.328196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:14.336322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:14.337676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:14.353250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:14.354181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:14.355066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:14.359165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 430/874] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:14.360545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:14.472966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a47e5-ad80-4d99-9c43-b01c295f2228 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:14.498497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:14.510984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:14.511960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:14.512497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:14.512980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:14.513999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:14.514513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:14.516208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db491-c1e6-48d5-bae3-ffd0c3cd501d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:14.530720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 445/875] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:14.537725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:14.645808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d0cc-ed82-49db-ae66-6b72154b95ab None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:14.674374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:14.688330 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:14.689001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:14.689276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:14.689543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:14.690407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=b8263daa298542be9a90840f5417e1f9) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:14.690713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:14.692431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc9fb0-2d33-4fb2-af6e-10a4adb0abb4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:14.704132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 431/876] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:14 2022] GET /identity/v3/role_assignments?user.id=b8263daa298542be9a90840f5417e1f9&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:15.706406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce24-e7e5-4469-bd1f-9193ce7a72f5 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:15.707044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce24-e7e5-4469-bd1f-9193ce7a72f5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:15.707044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce24-e7e5-4469-bd1f-9193ce7a72f5 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:15.708752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 446/877] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:15.714482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:15.715033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:15.715033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:15.738624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:15.740951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:15.834328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 432/878] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:15.858086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cce24-e7e5-4469-bd1f-9193ce7a72f5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:15.986629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cce24-e7e5-4469-bd1f-9193ce7a72f5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.025676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.026875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.027370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.027844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.039101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1a6dfe36-a5cb-4df7-9112-c067a926fee3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:16.048107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:16.049525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:16.050425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:16.053281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 447/879] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:16.064092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.126706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60bf57-f6cb-48c6-841d-f00ab7adeba4 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.127529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60bf57-f6cb-48c6-841d-f00ab7adeba4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.128054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60bf57-f6cb-48c6-841d-f00ab7adeba4 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.129888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 448/880] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:16.135908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.136506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.137099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.157009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:16.158558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:16.167872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b5a9-b49d-4943-8f88-89b414a4d1fb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.191523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.207527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.228623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.229292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.229569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.229839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.230616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:16.230919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.232323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.244138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 433/881] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:16.247806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.269765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 449/882] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:16.296389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.356172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad15d-b50c-4e25-bccc-6cde1d222bf8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.390849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.391545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.391857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.392131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.403673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.405170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.413851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2eba8-df4c-483f-a58c-5782f88c400a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b672c20a-9d19-4073-84e4-d81ae9b59253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:16.423137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:16.424396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:16.425294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:16.425294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:16.425294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:16.425294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:16.425294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 434/883] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:16.425999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9830f-8db1-424a-ab45-f8676b29074b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.426519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9830f-8db1-424a-ab45-f8676b29074b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.426519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9830f-8db1-424a-ab45-f8676b29074b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.431616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 435/884] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:16.431616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9830f-8db1-424a-ab45-f8676b29074b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.459043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.459857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.460170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.460438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.461093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.462554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.465698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f1a89d37-f44f-4480-be98-39e348ae1d4c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:16.476483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:16.477513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:16.483862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 450/885] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:16.484753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.484753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.484753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.498083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:16.499360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:16.531472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.552746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9830f-8db1-424a-ab45-f8676b29074b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.570989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 451/886] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:16.571731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.595210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.596477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.596862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.597036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.597761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:16.598065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.599522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.612613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 436/887] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:16.613414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.680932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210790b-cf20-4c48-b576-7247a7db7106 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.712826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.717070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.718298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.718769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.719193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.720073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:16.720546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.721912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.722495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f9d0-e40b-4a27-8a29-d7783438aa7e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.732267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 452/888] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:16.732267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.762853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:16.763030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.764224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.764487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.764837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.765656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.767255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:16.779647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:16.780714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:16.781524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 437/889] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:16.782302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.844258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e082-75f1-4413-bf41-ef3006573423 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.881804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.882616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.882900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.883175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.890888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.892440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.895155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43cb9c-e5a3-45bd-986a-9eb87b04ae88 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:16.907409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:16.908463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 453/890] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:16.909387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.932592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:16.933249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.933529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.933805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.934512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:16.934817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:16.936221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac2ef-d7db-4ea9-b39b-6b8568f8c020 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:16.941282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 438/891] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:16.943221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9f0c-02b5-4908-b348-bef314c8ceb6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:16.943514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9f0c-02b5-4908-b348-bef314c8ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:16.943789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9f0c-02b5-4908-b348-bef314c8ceb6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:16.945066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 439/892] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:16.945752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c9f0c-02b5-4908-b348-bef314c8ceb6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:16.968938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.006736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.016314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd89b88-e1d6-4e31-b6cf-5bf661aaadd1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.050267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c9f0c-02b5-4908-b348-bef314c8ceb6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.050473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.051039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.051326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.051603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.052865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:17.053168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.054548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.059090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 454/893] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:17.059865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.089792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.090453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.090730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.090997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.091817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:17.092160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.093578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd50ac-de07-4667-ae47-62806d312f1d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.115302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 440/894] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:16:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:17.116577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.116859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.117128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.133186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:17.134355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:17.164410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba7951-8328-4ae8-a7ce-a56d20858227 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.197764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.198432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.198711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.198978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.199753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] RBAC: Adding query filter params (interface=public, service_id=9e12cf54626449f385f6594943cea34b, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:17.199890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 441/895] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:17.200111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.201455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.206419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 455/896] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/endpoints?service_id=9e12cf54626449f385f6594943cea34b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:17.207181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.209503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.227133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.227462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.307884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a67d-1cf7-442b-8bab-2be2ebeb0b1b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.314446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473a60-8d06-4125-a7f4-2370dd98febc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.341452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.342103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.342804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.342804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.348137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.348793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.349070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.349339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.350067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:17.350368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.351999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.356973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 442/897] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:17.358107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.410786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.412793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.428934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.430960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.460664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91883-b81b-4f12-b8f1-01c90b686df8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.495283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.495932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.496235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.496504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.497181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.498543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.504074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 443/898] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:16:17.504832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.524140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 456/899] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:17.524140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.632102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d2fa-419d-421f-b884-bfc24569a0c1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.636643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf061-cc1a-4c8d-9bee-3bf552761f3e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.662271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.674726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.675773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.676304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.676597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.677847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.679254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.682432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.686469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.687137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.687462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.687691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.688517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] RBAC: Adding query filter params (interface=public, service_id=e114a17a8efb459e840e7814f66368e2, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:17.688825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.690211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:17.695808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:17.696873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:17.697693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:17.700171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 444/900] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:17.701120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 457/901] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/endpoints?service_id=e114a17a8efb459e840e7814f66368e2&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:17.701741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.702004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.810384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6571a-63b0-4e0b-a14b-319c61b160f4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.818551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc717df9-9174-4743-81e7-fb7238afa56a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:17.845919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.846587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.846874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.847147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.847886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.849825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.864050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 458/902] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:16:17.864050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.865687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:17.866515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:17.866930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:17.867214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:17.880410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:17.882173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:17.906407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:17.907363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:17.908272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:17.908272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:17.908272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:17.908272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:17.908272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 445/903] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:17.914014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:17.918908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:17.982403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d174-e801-4854-89c0-e9494dd686cc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.008426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:18.031778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.032514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.032794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.033066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.033785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:18.034076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.035562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.042197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 459/904] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:18.049324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:18.056152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649893f-d5e0-48d4-9c8d-d12224106f2d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.103617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.109098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.109456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.109986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.111070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:18.111916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.113762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.131580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 446/905] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:18.136675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:18.173762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175122e0-0c9f-4d4d-88f5-2f2f9666e3a1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.185917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:18.210138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.211079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.211542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.211969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.212840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:18.213370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.214975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.220527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 460/906] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:18.266559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53e86-579a-4673-95d3-1edf626a42da None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.296443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:18.309314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.310523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.311018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.311521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.320534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.322488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:18.338439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:18.339400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:18.340317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:18.343027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 447/907] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:18.350054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:18.469445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c8aac-500c-408d-89a3-172112ae380c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.505527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.506183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.506464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.506735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.507518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:18.507822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.509279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a23f-5dd5-48f2-bce7-adcdb000fac9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.522576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 461/908] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:18.528426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:18.635781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b0fa-b29a-4876-890b-03b3897636fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:18.673298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:18.674429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:18.674935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:18.675407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:18.676475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] RBAC: Adding query filter params (role.id=433ccd880f27469db3a436ecdc50a154, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=00ad856d9989434f871d7facb6b69a8a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:18.677574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:18.679406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e03a9-1db5-4ea0-a07e-591c3734a763 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:18.686067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 448/909] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:18 2022] GET /identity/v3/role_assignments?user.id=00ad856d9989434f871d7facb6b69a8a&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=433ccd880f27469db3a436ecdc50a154 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:19.616747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822800f-294e-4c8e-980f-02e5c51af2e8 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:19.617270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822800f-294e-4c8e-980f-02e5c51af2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:19.617383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822800f-294e-4c8e-980f-02e5c51af2e8 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:19.618888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 462/910] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:19.624311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:19.624752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:19.624925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:19.642883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:19.644452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:19.684285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:19.727691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 449/911] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:19.750210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822800f-294e-4c8e-980f-02e5c51af2e8 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:19.792131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:19.864962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822800f-294e-4c8e-980f-02e5c51af2e8 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:19.900574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:19.901298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:19.901580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:19.901854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:19.902491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:19.903854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-06791e2e-94e6-4a00-bea3-69e7d4c43809 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:19.917408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:19.918366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:19.919186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 463/912] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Jun 24 14:16:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:19.925042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.033599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd6650-7adf-43cc-b82e-91fb6c553b53 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.059902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643de3a-012c-46b0-b238-cdac49553d52 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.060243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643de3a-012c-46b0-b238-cdac49553d52 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.060514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643de3a-012c-46b0-b238-cdac49553d52 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.063350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 464/913] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:20.067713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.068010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.068322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.071228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.072195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.072674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.073144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.074115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:20.074642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.076085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.081417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 450/914] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:20.087059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.087606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:20.089151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:20.128048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.168499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 465/915] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:20.190810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.221399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c32c2-6545-4d27-8017-503b36046f5f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.236765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.269128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.269790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.270073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.270348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.271648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:20.271953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.273475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.283799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 451/916] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:20.284855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.309861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635d728-65cf-405d-9fd5-72daf55aad8d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.346265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.348139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.348668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.349947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.351475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.353578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:20.369214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:20.370235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 14:16:20.371040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:20.374961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 466/917] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:20.379459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.398415 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.406350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803ec19-98e1-4069-a804-276295b03ee4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.445034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.445711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.445993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.446267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.447003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.448421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa7db-38e5-4081-90ce-62e043bacb68 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.476245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 452/918] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:20.477852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e241b-7647-498d-b387-f8ce9970f1c5 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.478155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e241b-7647-498d-b387-f8ce9970f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.478254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.478430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e241b-7647-498d-b387-f8ce9970f1c5 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.480207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 453/919] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:20.485856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.486224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.486387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.495937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e8dc2-5b52-4cb4-b081-566790a8bd08 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.506284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:20.507518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:20.543885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.544777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.545205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.545575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.546399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:20.546859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.548496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.559082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 467/920] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:20.560056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.612649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 454/921] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:20.639265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.688379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299478-b54d-415c-8f39-ddd40eeb8b81 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.733399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.734256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.734546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.734823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.735537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:20.735841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.738246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.744941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 468/922] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Jun 24 14:16:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:20.752153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:20.754513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.781862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7a86-5322-4777-9aec-b0f4d8e6d4c9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.788531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:20.826439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.827259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.827654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.827928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.828839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.830783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8599522-9300-4cdf-8fb8-ca122c34d7b6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.854827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 455/923] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:20.854827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd602-c988-4d43-8f44-36ddb3ee1e3a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.854827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd602-c988-4d43-8f44-36ddb3ee1e3a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.854827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd602-c988-4d43-8f44-36ddb3ee1e3a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.854827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 456/924] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:20.864428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.864703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.864961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.878628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cdd8-07f4-4984-98db-d579c1aaf464 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:20.888179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:20.890082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:20.935943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:20.936749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:20.937034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:20.937360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:20.938693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:20.940779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:20.976675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 469/925] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:20.995687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 457/926] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:21.019855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:21.109742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:21.155050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b863-2bc4-4a2b-a19c-a7ce9c699b44 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:21.197521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:21.198705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:21.199194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:21.199699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:21.212148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:21.222198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:21.224285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:21.225863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:21.229202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 470/927] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:21.236673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:21.312431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:21.350882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e74e68-6153-45cb-ae00-4939c5af6246 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:21.386597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:21.387262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:21.387545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:21.387822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:21.388611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:21.388917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:21.390308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:21.400465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 458/928] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:21.406229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:21.524167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb405-91e6-4c3f-b8e8-d5139103f78b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:21.558780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:21.563048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:21.563787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:21.564284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:21.564558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:21.576042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:21.577499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:21.594847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:21.596730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:21.597924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:21.597924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:21.597924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:21.597924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:21.597924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 471/929] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:21.602094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:21.715672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4242a-14f8-4fa6-a5d5-bd4bc872cfa5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:21.744575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:21.752923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:21.753665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:21.753951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:21.754228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:21.755023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:21.755328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:21.756747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:21.774764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 459/930] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:21.777464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:21.892638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd36b-aa80-4beb-ad0c-55c688b73021 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:21.928313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:21.929127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:21.929402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:21.929670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:21.937619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:21.939062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:21.953869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:21.955769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:21.957087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 472/931] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:21.961085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.071173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69257-9635-454f-868c-666503bb8514 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.109496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.110226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.110506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.110830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.111673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:22.111979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:22.113450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:22.134396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 460/932] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:16:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:22.139882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.193961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:22.277166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66357329-5f2a-40ee-9ac3-f54b09566706 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.314347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.315139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.320402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.320779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.333562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:22.335099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:22.355654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:22.358766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:22.360955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:22.360955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:22.360955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:22.360955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:22.360955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 473/933] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:22.369205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.420373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:22.482640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28393d8-0e51-40ce-8613-5b235795cbf9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.518558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.519236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.519514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.519786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.521211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:22.521515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:22.522904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd4a8-6c0c-4fcb-a454-ad3fb24da4fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:22.535574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 461/934] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:22.541479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.645163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:22.663322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bdfe1-5773-453d-8c43-fb7e3cebf04a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.698103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28343-5a99-49b4-a0ac-192569bb9285 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.698416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28343-5a99-49b4-a0ac-192569bb9285 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.698665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28343-5a99-49b4-a0ac-192569bb9285 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.700190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 462/935] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:22.705055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.705345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.705625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.708497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.709913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.710659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.711292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.720777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:22.722551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:22.722840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:22.724605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:22.740619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:22.741566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:22.742433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:22.744985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 474/936] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:22.753937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.803829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 463/937] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:22.825596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.870810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:22.889011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3996348-21e7-49ac-8d9f-01c1845386d8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.930404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.931524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.932013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.932566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.933563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:22.934122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:22.935893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:22.943951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e0da-76c7-491d-96de-1ef89e0ff7d1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:22.949735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 475/938] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:22.958066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:22.977772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:22.997966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:22.998681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:22.998957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:22.999227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:22.999878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.001282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:23.019251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:23.020352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:23.021722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.026241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 464/939] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:23.027168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.091999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efb0a-9e58-4a8d-8c2e-b2a7ef6b8bf7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.130563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.131375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.132242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.132702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.133012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/00ad856d9989434f871d7facb6b69a8a/roles/433ccd880f27469db3a436ecdc50a154` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.133891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda1f0f-b5cb-41d2-9dc8-4d6ed28a7bf7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.135259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=00ad856d9989434f871d7facb6b69a8a, role_id=433ccd880f27469db3a436ecdc50a154)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.136745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb70f-911a-4749-a11e-36b6904fdfec None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.156065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 476/940] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:22 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/00ad856d9989434f871d7facb6b69a8a/roles/433ccd880f27469db3a436ecdc50a154 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:23.156065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b40e-33d2-432f-bd96-eacb37cd5a35 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.156065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b40e-33d2-432f-bd96-eacb37cd5a35 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.156065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b40e-33d2-432f-bd96-eacb37cd5a35 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.156065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 477/941] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:23.158674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7f4f-ade9-43f5-8bfb-a036cb348a77 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.158971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7f4f-ade9-43f5-8bfb-a036cb348a77 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.159250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7f4f-ade9-43f5-8bfb-a036cb348a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.182358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-09ec7f4f-ade9-43f5-8bfb-a036cb348a77 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:23.183589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-09ec7f4f-ade9-43f5-8bfb-a036cb348a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:23.194374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.195972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.196531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.197447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.198705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:23.199242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.201459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.208847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 465/942] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:23.216594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.270315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 478/943] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:23.272150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32c51-ee80-4219-86fd-99925d1dee02 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.272438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32c51-ee80-4219-86fd-99925d1dee02 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.272714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32c51-ee80-4219-86fd-99925d1dee02 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.274161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 479/944] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:23.279792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.280133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.280392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.287138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.298399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:23.299853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:23.358458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a938-b382-41b3-9bf4-456e8bfdcb80 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.386922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 480/945] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:23.388124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.403360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.404774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.405137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.405491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.406315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:23.407060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.408852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.415337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 466/946] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:23.416166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.452256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.533909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea148b-7260-47ac-9066-9aba88ca8ab1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.558532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2566-bacc-452a-a261-027e54950c61 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.569178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.575278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.576328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.578158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.578713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.579525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.581029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:23.595603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:23.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:23.597471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 481/947] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:23.603539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.605529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.606194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.606625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.606793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.607503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.609109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.610548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING keystone.server.flask.common [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 14:16:23.631221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.sql.core [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 14:16:23.631221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 14:16:23.631221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [parameters: {'id': 'b281748a74ce4d21920c26735783e16e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 14:16:23.631221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80140) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b281748a74ce4d21920c26735783e16e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b281748a74ce4d21920c26735783e16e. Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:16:23.639491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 14:16:23.640348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application yield resource Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise self.value Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application session.commit() Jun 24 14:16:23.641309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.flush() Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application compat.raise_( Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 14:16:23.642184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 14:16:23.643078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:16:23.643862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [parameters: {'id': 'b281748a74ce4d21920c26735783e16e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.650882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:23.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b281748a74ce4d21920c26735783e16e. Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.654899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 467/948] 10.222.0.13 () {60 vars in 1140 bytes} [Fri Jun 24 14:16:23 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:23.661534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.729581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745442-7c28-40a9-8c02-adc9fd1c7dc4 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.775068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.775707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.775993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.776315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.777083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:23.777383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.779045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.783130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.790120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 482/949] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:23.791578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.807010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b004-9f14-4601-813c-ce821b05f3fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.844998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.846097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.846622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.847094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.855542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.857521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.858931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:23.875012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:23.875978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:23.877200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:23.884347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 468/950] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:23.885642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:23.905793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90785-c0d8-48b9-ac17-a165781414e6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:23.946072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:23.946772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:23.947053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:23.947328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:23.948229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:23.948481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:23.949902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:23.960710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 483/951] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:23.961791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:24.010636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1872-b0e4-4a6d-9e35-b6606fa26be4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:24.050136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:24.051212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:24.052523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:24.053003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:24.053966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:24.054492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:24.056400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:24.075512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff9eb-d275-41c2-9654-920b4419d5ed None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:24.088499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 469/952] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:24.101975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:24.115021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:24.116215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:24.116603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:24.116992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:24.117925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] RBAC: Adding query filter params (interface=public, service_id=41aa315365b742ffba315340c7f28b06, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:24.118345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:24.119865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83e727-68ec-4140-b7e1-ef8b99459a54 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:24.126413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 484/953] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:23 2022] GET /identity/v3/endpoints?service_id=41aa315365b742ffba315340c7f28b06&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:24.132482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:24.137484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:24.254864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da52038-1b56-44a2-a69e-3fdae5602602 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:24.291684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:24.292387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:24.292666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:24.292941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:24.293630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:24.295032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c85b4-4047-485c-8586-16132402aee9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:24.303179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 470/954] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:24 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:16:25.265889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d440-f5c5-495c-b1ba-e405065b0f6f None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.266730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d440-f5c5-495c-b1ba-e405065b0f6f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.267149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d440-f5c5-495c-b1ba-e405065b0f6f None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.268989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 485/955] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:25.275563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdc5b-19e0-42a5-aca0-3b04a9df15e7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.276446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdc5b-19e0-42a5-aca0-3b04a9df15e7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.276920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bdc5b-19e0-42a5-aca0-3b04a9df15e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.295936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-667bdc5b-19e0-42a5-aca0-3b04a9df15e7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:25.297921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-667bdc5b-19e0-42a5-aca0-3b04a9df15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:25.366172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:25.374289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 471/956] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:25.398688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d440-f5c5-495c-b1ba-e405065b0f6f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:25.515220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d440-f5c5-495c-b1ba-e405065b0f6f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:25.534088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db84e9b-73d1-49e0-8265-0c248b2019e1 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.534777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db84e9b-73d1-49e0-8265-0c248b2019e1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.535348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db84e9b-73d1-49e0-8265-0c248b2019e1 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.537306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 472/957] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:25.545246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.545246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.545246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.555488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:25.556342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.556623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.556895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.568997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:25.570207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:25.570986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:25.579640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:25.580721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:25.581594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 486/958] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:25.593094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:25.648860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 473/959] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:25.656416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:25.677162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:25.705470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6c04e-0e57-467b-ac5a-ce8eb789a1ef None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:25.745733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:25.746406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.746684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.746952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.747801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:25.748144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:25.749675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:25.766753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 487/960] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:25.767973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:25.809461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12783d9b-5d49-4336-b6e1-ec9090da21d8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:25.838936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:25.849348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:25.850031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.850311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.850856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.851585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:25.853375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:25.869085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 474/961] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:25 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:25.905173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403308e-ba2b-4cf0-acfa-98f86a42ea6f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:25.917712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:25.953135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:25.953955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:25.954232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:25.954503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:25.966946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:25.968453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:25.987853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:25.988827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:25.990309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:25.990309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:25.990309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:25.990309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:25.990309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 488/962] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:25.996593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.112074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b5422-b471-4e83-8754-a3b79d5868d5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.148821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.149483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.149764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.150041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.150771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:26.151079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.152551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb51d-f4e6-4792-8431-d6b59b8cb999 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.166344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 475/963] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:26.171515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.281217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520c40-d3e1-4bca-ab7c-3e3ae85f9882 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.318718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.319529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.319804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.320105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.328519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.329968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:26.345357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:26.346359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.347288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 489/964] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:26.347898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ba9d8-cb36-47ac-9784-2330b9f1b3ce None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.347898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ba9d8-cb36-47ac-9784-2330b9f1b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.347898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ba9d8-cb36-47ac-9784-2330b9f1b3ce None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.349203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 476/965] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:26.352741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.355084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d047-3e52-4b43-8574-a92941ec189c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.355374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d047-3e52-4b43-8574-a92941ec189c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.355653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652d047-3e52-4b43-8574-a92941ec189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.374485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8652d047-3e52-4b43-8574-a92941ec189c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:26.376149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8652d047-3e52-4b43-8574-a92941ec189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:26.379307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:26.444189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:26.472926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae50d7-6762-4dfe-b05e-d35fc68cb7c2 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.476077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 477/966] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:26.476077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401236-bc3b-478b-84b9-b27618e45d8f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.476077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401236-bc3b-478b-84b9-b27618e45d8f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.476392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401236-bc3b-478b-84b9-b27618e45d8f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.480061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 478/967] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:26.483076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.483368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.483642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.501092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:26.502393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:26.518436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.519418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.519701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.520039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.521787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:26.522091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.523532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.541257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 490/968] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:26.542062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.581730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 479/969] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:26.582871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.632362 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:26.661751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361904-f33f-41c7-8e8d-7bb12a5d47bf None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.698447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a91999-9201-45b9-be4e-25cb9b44a418 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.707572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.708837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.709115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.709381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.709835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:26.710666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.712358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.713794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING keystone.server.flask.common [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 14:16:26.727786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.sql.core [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 14:16:26.727786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 14:16:26.727786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [parameters: {'user_id': 'fd654e0660d4442dae382dab69462773', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 14:16:26.727786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80139) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 14:16:26.737084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.737729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.738005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.738274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application result.read() Jun 24 14:16:26.745342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:16:26.746252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application yield resource Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise self.value Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application session.commit() Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 14:16:26.752130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self.session.flush() Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application compat.raise_( Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 14:16:26.753374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:16:26.754500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application result.read() Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:16:26.756151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd654e0660d4442dae382dab69462773', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:26.757285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 14:16:26.758295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 491/970] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Jun 24 14:16:26 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:26.759416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.827440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.828929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.869921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da3d0-aac0-43db-b4a8-dcf0d409bb84 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:26.907330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:26.908465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:26.908956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:26.909436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:26.910696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:26.913156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:26.927248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:26.928647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:26.929700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:26.931843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 492/971] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:26.932780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.935480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:26.942791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 480/972] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:26.944006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:26.958011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:27.049426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806b7d-b18a-4b33-8a98-5685aa4979fe None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.055254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5f7d3-15cd-4dea-b9df-4b970955ddf0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.090731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.091388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.091667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.091938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.092661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:27.092959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.093073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.093908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.094260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.094368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.094646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.101025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 481/973] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:27.102103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.106160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.107747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:27.123411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:27.130384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 493/974] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:27.131551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.188846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:27.193315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:27.229448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a43f5-e25e-4f4b-bc2f-16f69a9032ea None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.238897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ddff-fe05-4b85-a3d6-7347727ae238 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.267500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.268546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.268899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.269269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.275069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.275732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.276013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.276330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.277038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:27.277348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.278829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.281166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.282652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.291812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 494/975] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:27.291812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:27.305177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:27.306060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:27.306947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:27.306947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:27.306947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:27.306947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:27.306947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 482/976] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:27.307796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.408357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259ac41-dbf3-481a-b366-d459dc572b1b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.414345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87349-2a3e-444e-afd5-bd70c357eb2c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.437287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:27.438657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:27.449206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.449802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.450079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.450248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.450357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.450897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.451150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:27.451265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.451460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.451559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.452320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.452977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.453705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.484063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 483/977] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:27.484063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.499840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 495/978] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:27.631145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02563792-8262-4a75-925c-2fd7d6d0c86d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.674586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.675258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.675539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.675849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.677114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:27.677420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.678897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.696111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 484/979] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:27.700351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.823873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b16a-2a04-4061-b9e9-3076ae3fc109 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:27.860658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:27.861444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:27.861721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:27.861991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:27.868920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:27.870355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f37badc6-f02e-4332-888b-28c2dee7faff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:27.886232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:27.887759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:27.889400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 496/980] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:27.891914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:27.943447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:28.033590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc5d-6f4d-4f42-a591-564c5ed7f560 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.070814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.071473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.071752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.072083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.072845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:28.073151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.074580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.079378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86d30-a057-40af-803c-b5bcf44ac400 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.079668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86d30-a057-40af-803c-b5bcf44ac400 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.079941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86d30-a057-40af-803c-b5bcf44ac400 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.081468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 497/981] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:28.086783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.087068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.091884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.092056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 485/982] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:28.094293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.108534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:28.110303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:28.153659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:28.184238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 498/983] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:28.205967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:28.206941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.223112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70950-3129-44bb-b2c4-52c094e7fe20 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.262312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.262990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.263282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.263546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.264468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] RBAC: Adding query filter params (role.id=433ccd880f27469db3a436ecdc50a154, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=00ad856d9989434f871d7facb6b69a8a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:28.264788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.266281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.284151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 486/984] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/role_assignments?user.id=00ad856d9989434f871d7facb6b69a8a&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=433ccd880f27469db3a436ecdc50a154 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:28.335674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff1059-2161-4c75-a453-8cdb85716120 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.375012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.375823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.376141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.376391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.377101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.378603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:28.391229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:28.392648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:28.393518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:28.396387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 499/985] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:28.399088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.508887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e3cf2-6686-4f13-96af-5b4b411f3a02 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.543850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.544466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.544749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.545028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.545736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:28.546043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.547421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.553055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 487/986] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:28.558773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.601722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:28.669293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38d25-c25a-482c-a40b-3edb4913cd9c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.706041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.706718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.707003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.707280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.708596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:28.708906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.710343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.716289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 500/987] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:28.722153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.749330 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:28.837641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cbc1-b0ca-4d7a-a0e3-a9efc71507b5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:28.872671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:28.873379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:28.873703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:28.873946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:28.874921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] RBAC: Adding query filter params (interface=public, service_id=98d0197615544599a12621090bc0c4f2, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:28.875235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:28.876665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0198da-667d-4b2c-93fe-a79ad100dfe2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:28.885468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 488/988] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/endpoints?service_id=98d0197615544599a12621090bc0c4f2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:28.890945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:28.999549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55925d-f11d-47fe-ad06-2d98654cfde8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:29.001150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:29.036845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:29.037503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:29.037783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:29.038054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:29.038725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:29.040258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb745-3a36-4cec-b1a9-b1661af7e4c4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:29.046886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 501/989] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:28 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:16:29.667871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06fae-304a-4f06-8b1b-e4563bc7579b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:29.668435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06fae-304a-4f06-8b1b-e4563bc7579b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:29.668922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c06fae-304a-4f06-8b1b-e4563bc7579b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:29.671545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 489/990] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:29.677328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:29.678026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:29.678026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:29.697006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:29.698843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:29.793522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 502/991] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:29.822015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c06fae-304a-4f06-8b1b-e4563bc7579b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:29.922554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:29.939508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c06fae-304a-4f06-8b1b-e4563bc7579b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:29.980841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:29.981810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:29.982095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:29.982552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:29.983526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:29.985577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:29.999024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:30.000222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:30.001066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:30.004116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 490/992] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:30.008361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.164131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:30.181205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939722c-92a6-47fb-b020-4c25bf65cf3d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:30.255235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:30.256745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.257218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.257695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.258726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:30.259146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:30.261092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78c68f-fcb0-427b-9d16-f1fd09247382 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:30.268263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 503/993] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:30.274971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.408184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59d98-d42e-4829-874a-dffb65b3b77e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.408475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59d98-d42e-4829-874a-dffb65b3b77e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.408858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59d98-d42e-4829-874a-dffb65b3b77e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.420048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 504/994] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:30.420048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.420048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.420048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.424414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704238a-51d2-4bf9-b4b4-b73ef5ad0ce0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:30.448134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:30.448134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:30.472051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:30.472051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.472051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.472051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.472466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:30.472466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:30.472846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:30.488055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 491/995] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:30.488055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.506586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:30.548065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 505/996] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:30.563466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.624834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698991a-7ae5-4581-91d0-93ec94fe7994 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:30.684569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:30.686084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.686604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.687107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.688189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] RBAC: Adding query filter params (interface=admin, service_id=41aa315365b742ffba315340c7f28b06, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:30.688743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:30.690376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:30.703626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 492/997] 10.222.0.13 () {56 vars in 1249 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/endpoints?service_id=41aa315365b742ffba315340c7f28b06&interface=admin®ion_id=RegionOne => generated 193 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:30.705149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.706879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:30.731817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd8894-eead-491d-a011-c9503d1ec6e1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:30.805040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:30.806559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.807060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.807524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] PATH_INFO: `/v3/services/image` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.808658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:30.811280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:30.837653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:30.841303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:30.842366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:30.843204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:30.846122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 506/998] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/services/image => generated 86 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:30.854980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:30.871827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0746-388f-4d2c-81e9-6f5ab7417c40 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:30.924583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:30.925697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:30.926195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:30.927362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:30.928543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:30.930230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:30.956134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 493/999] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/services => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:16:31.005451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4a3-74d9-4620-9686-19e7e4380283 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:31.059478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:31.060198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.060481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.060751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.061615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] RBAC: Adding query filter params (name=image) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:31.061925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:31.063402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61646a88-17c3-4ca5-b9cf-917eeeea2b7f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:31.075408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 507/1000] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:31.076859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:31.210295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabf76-f3d5-4820-acb4-8ac722081b65 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:31.258846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:31.259693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.260134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.260539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.261387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:31.261848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:31.263422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697954-26d1-4106-a72e-89ed50e47ee7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:31.276109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 494/1001] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:31.330170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec232de-551e-4a64-b227-6ced7b5d3cea None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.330170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec232de-551e-4a64-b227-6ced7b5d3cea None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.330170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec232de-551e-4a64-b227-6ced7b5d3cea None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.330941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 508/1002] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:31.336869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.337170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.337441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.358743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:31.360288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:31.362920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:31.457104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 495/1003] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:31.483175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec232de-551e-4a64-b227-6ced7b5d3cea None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:31.517159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:31.639241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec232de-551e-4a64-b227-6ced7b5d3cea None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:31.678255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:31.679025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.679300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.679628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.680309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:31.681670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:31.693986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:31.695662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 14:16:31.698072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:31.700820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 509/1004] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:31.702030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:31.820190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723cc1-77f4-4933-a3ec-8a666341f0fa None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:31.860834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:31.861492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:31.861765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:31.862032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:31.862733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:31.863030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:31.864668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:31.875448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 496/1005] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:31.875597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:31.965538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:31.985732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5ed34-6aa7-4d35-8dbc-38deb164cea7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:32.021470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:32.022127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:32.022408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:32.022682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:32.023383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:32.023687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:32.025119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572257fb-3517-48ee-999a-2997cc6c6c1f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:32.034754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 510/1006] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Jun 24 14:16:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:32.036081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:32.039238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:32.146563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652f1d-2806-4d50-89c8-28ab81b8e8c3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:32.182416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:32.183071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:32.183354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:32.183629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:32.184406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:32.186092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af8028-d7e0-4c4d-9467-2a8690d60bd9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:32.205571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 497/1007] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:33.065193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757dcf-f34a-4cc4-b0fb-6d360523743e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.065720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757dcf-f34a-4cc4-b0fb-6d360523743e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.065798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da757dcf-f34a-4cc4-b0fb-6d360523743e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.067266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 511/1008] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:33.072523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.072931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.073095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.090294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:33.091496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:33.155140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:33.180746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 498/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:33 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:33.204850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da757dcf-f34a-4cc4-b0fb-6d360523743e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:33.310269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da757dcf-f34a-4cc4-b0fb-6d360523743e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:33.348863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:33.349590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.349876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.350153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.351063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:33.352467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-c9f8e4db-aa5d-4e06-8a10-8d7679330752 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:33.365372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:33.366500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 14:16:33.367348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:33.371512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 512/1010] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Jun 24 14:16:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:33.373046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:33.420130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0d06-8510-43de-bfa8-a7a950c655b0 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.431450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0d06-8510-43de-bfa8-a7a950c655b0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.431450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0d06-8510-43de-bfa8-a7a950c655b0 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.431450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 513/1011] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:33.432011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.432011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.432377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.450361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:33.451547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:33.454590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:33.500938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7173-e75a-4093-866f-2ef8424e6987 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:33.532399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 514/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:33 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:33.540179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:33.540819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.541101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.541101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.542070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:33.542373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:33.543775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:33.554042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 499/1013] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:33.555392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:33.556477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:33.612131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:33.674680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0073c5-5ad5-4164-9297-1f0a3b00439e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:33.682612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071acf80-eecb-4014-bf6d-46f510c48a37 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:33.712434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:33.713136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.713417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.713693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.714414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:33.715765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ebd9-0ea7-44ee-a86e-82e82abaf545 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:33.720615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:33.721366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.721558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.721864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.722618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:33.722857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:33.724479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:33.730597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 515/1014] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Jun 24 14:16:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:33.739467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 500/1015] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:33 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:33.739709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:33.746663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:33.860335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f540c-df07-4c0f-a6de-5a4b540c4344 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:33.909823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:33.910400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:33.910772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:33.911047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:33.911777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:33.913174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7525-9882-4f6e-a9cd-35d74df6b235 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:33.928839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 516/1016] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:34.396115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f61a-31a6-4bb0-a1ad-32c959702138 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:34.396655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f61a-31a6-4bb0-a1ad-32c959702138 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:34.396655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f61a-31a6-4bb0-a1ad-32c959702138 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:34.398176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 501/1017] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:34.403359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:34.403941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:34.404175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:34.421502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:34.422688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:34.487084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:34.506836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 517/1018] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:34.530251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28f61a-31a6-4bb0-a1ad-32c959702138 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:34.635328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28f61a-31a6-4bb0-a1ad-32c959702138 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:34.645519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:34.672523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:34.673333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:34.673616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:34.673893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:34.684980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:34.693525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:34.694557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:34.695456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:34.696986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 502/1019] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:34.700684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:34.804577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5e46-1277-4427-b11a-456bf5e84611 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:34.839418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:34.840120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:34.840406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:34.840681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:34.841529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:34.842058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:34.843461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:34.856582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 518/1020] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:34.857827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:34.965844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3b9c-8d53-4b4d-9d33-6d07294b742a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:35.000529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:35.001317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.001592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.001861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.016148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:35.017598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:35.035192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:35.036716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:35.037617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:35.037617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:35.037617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:35.037617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:35.037617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 503/1021] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:35.043100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:35.096556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:35.150280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023b84-5457-4647-aa10-86f19dc01e34 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:35.185907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:35.186565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.186845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.187120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.187834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:35.188171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:35.189541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:35.202527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 519/1022] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:35.208733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:35.246220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:35.327649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440e60-8a0f-4bd2-a146-dc86790f6d24 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:35.362487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:35.363201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.363486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.363790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.371395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:35.373404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:35.388055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:35.389329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:35.390270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 504/1023] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:35.397195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:35.498349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08848f-b122-42d0-b2ca-d3052cd08e71 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:35.508482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:35.534979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:35.536225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.536543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.536854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.537734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:35.538053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:35.539492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18170651-58c9-4695-b27e-08ef7d1b76cc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:35.562021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 520/1024] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:35.563501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:35.646417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:35.667160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cd6ae-bd6d-4f02-82fa-f0a1f9e98bec None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:35.707214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:35.708565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.708875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.709151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.777686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:35.779145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:35.848807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc973a7-bdf2-4854-83e6-5dd7e2daafd7 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.849164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc973a7-bdf2-4854-83e6-5dd7e2daafd7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.849387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc973a7-bdf2-4854-83e6-5dd7e2daafd7 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.851139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 521/1025] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:35.856252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:35.856668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:35.856875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:35.864394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:35.882597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:35.883814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:35.895610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 505/1026] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 14:16:35.901299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:35.964832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 522/1027] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:35.987367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.016824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd16649-2574-4033-b732-85820c04abf9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.052954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.053736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.054014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.054285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.064389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.065844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.081358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ac8e7d3f-4271-4f3c-9e54-69617ea34b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:36.085406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:36.086312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:36.087285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:36.087285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:36.087285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:36.087285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:36.087285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 506/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:36.088010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b0ed-24d2-4af7-9144-873d1ac8e48a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.088317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b0ed-24d2-4af7-9144-873d1ac8e48a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.088591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8b0ed-24d2-4af7-9144-873d1ac8e48a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.090083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca1d1d-749d-46f2-9467-4cb6cd686802 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.093781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 507/1029] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:36.094517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b0ed-24d2-4af7-9144-873d1ac8e48a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.125432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.126305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.126591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.126869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.127520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.127678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.128917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-bf00d8ae-983c-4f0a-8ba8-45bdd3df8ce9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:36.140976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:36.142248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:36.143091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 523/1030] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Jun 24 14:16:35 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:36.143980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.143980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.143980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.161318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:36.162350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:36.203445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8b0ed-24d2-4af7-9144-873d1ac8e48a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.230016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 524/1031] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:36.230886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.248139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.248806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.249086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.249357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.250093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.250378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.251754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.265387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 508/1032] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.266223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.333598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.343298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc3db-8ee6-485b-b6c8-d2d631feccad None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.359222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.368707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb27dd-abe9-4103-9324-e18a702fc074 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.376680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.377347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.377670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.377970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.378719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] RBAC: Adding query filter params (name=image) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.379040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.380968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.385792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 525/1033] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.386568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.408159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.408939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.409217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.409484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.411150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.412671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.414261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 509/1034] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.415008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.488696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88f9f-000e-41ad-9399-ab2c8c0f361f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.512411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0f077-db3c-44e2-a90a-6473c00e511d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.523584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.524406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.524716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.525014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.531988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.533455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.545808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.546457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.546736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.547007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.547743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] RBAC: Adding query filter params (type=image) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.548072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:36.548177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:36.549210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:36.550123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 526/1035] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:36.550643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.550714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.563735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 510/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.563735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.570140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.587757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.653820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9538-28aa-48bf-ba53-842869e214a0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.666161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8041b1-8486-4117-b047-ffbb0f37472c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.688052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.688721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.689003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.689278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.689982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.691449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.699233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.699890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.700200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.700523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.701391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.701907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.703464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.716582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 511/1037] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.717369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.724520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 527/1038] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:16:36 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:16:36.725610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.799326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.821974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:36.839891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb7afb-5a22-4c07-a9cb-bff7732c55e3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.844945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5e10-b541-48e7-85a9-18421dff3abc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:36.881391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.882299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.882299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.882597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.883359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] RBAC: Adding query filter params (interface=public, service_id=ad4ddb531e8b45c1bcfb2d6e91b19081, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.883664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.885062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.891318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:36.892592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:36.892592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:36.892592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:36.892957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 512/1039] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/endpoints?service_id=ad4ddb531e8b45c1bcfb2d6e91b19081&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:36.893373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] RBAC: Adding query filter params (role.id=433ccd880f27469db3a436ecdc50a154, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:36.893721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:36.895239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8911439-a5fa-4d24-a9c4-6a2d5354dfce None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:36.898199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:36.906619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 528/1040] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=433ccd880f27469db3a436ecdc50a154 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:37.018094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d0e1-6de4-4e0e-9d01-95c23d6c76e5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:37.055516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:37.056211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:37.056488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:37.056757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:37.057436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:37.058810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac4281-3bbe-4cb7-8430-917132b4db22 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:37.067351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 513/1041] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:16:36 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:16:38.843635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb3fa6-2ec1-4a19-9d7a-4fc6cd939f1e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:38.844222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb3fa6-2ec1-4a19-9d7a-4fc6cd939f1e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:38.844501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb3fa6-2ec1-4a19-9d7a-4fc6cd939f1e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:38.845826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 529/1042] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:38.851515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe20f-66f9-41bc-9ada-9ddf17c144a3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:38.851933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe20f-66f9-41bc-9ada-9ddf17c144a3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:38.852065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe20f-66f9-41bc-9ada-9ddf17c144a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:38.869418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e14fe20f-66f9-41bc-9ada-9ddf17c144a3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:38.870608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e14fe20f-66f9-41bc-9ada-9ddf17c144a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:38.880084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:38.943787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 514/1043] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:38.949840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0cdf-6bf7-4b9c-a4e1-193ce00a43aa None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:38.950275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0cdf-6bf7-4b9c-a4e1-193ce00a43aa None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:38.950565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0cdf-6bf7-4b9c-a4e1-193ce00a43aa None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:38.952054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 530/1044] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:38.957039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:38.959193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:38.959482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:38.968419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a0cdf-6bf7-4b9c-a4e1-193ce00a43aa None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:38.977045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:38.978218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:39.071137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 515/1045] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:39.094534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.104428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a0cdf-6bf7-4b9c-a4e1-193ce00a43aa None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.137549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.144907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.145700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.146045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.146247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.147420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.148885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.150659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 531/1046] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:39.156050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.169368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.198732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886bf57-59b0-425e-a9a2-e700821b3be3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.235324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.236163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.236445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.236718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.247721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e258e4b7-7cc3-4248-b53e-5da116bfa4fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:39.256411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:39.257332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:39.258163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 516/1047] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:39.258869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ddc-a007-475d-b982-2a487f1f8710 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.259495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ddc-a007-475d-b982-2a487f1f8710 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.259495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ddc-a007-475d-b982-2a487f1f8710 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.260722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 517/1048] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:39.264179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ddc-a007-475d-b982-2a487f1f8710 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.264978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f982ba-c2b5-4b73-b167-2e678720d3b6 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.299451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.300133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.300413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.300690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.301426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.302846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe0732-c209-4030-bd79-40f4b9db495f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.322667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 532/1049] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:16:39 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:39.323780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.324064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.324348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.342293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:39.343530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:39.389611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ddc-a007-475d-b982-2a487f1f8710 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.400137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.420304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 533/1050] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:39.425339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.431583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.432292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.432577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.432853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.433625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:39.433933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.435367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.443570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.446334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 518/1051] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:39.452237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.565437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc47a-8f32-499c-ad31-1c6b6a028ca0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.568459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e17fe-68cc-427e-b764-28e81f682f35 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.605024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.605812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.606091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.606399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.607843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.609121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.609929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.610366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] PATH_INFO: `/v3/services/image` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.611156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.612699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.617280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.618724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:39.628315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:39.629451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:39.635446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 534/1052] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:39.636311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:39.645452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:39.646341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:39.647242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:39.647242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:39.647242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:39.647242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:39.647242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 519/1053] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:39.652665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.692343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.710324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.756176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353276c-43a4-4d4d-a8bc-d621313264cc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.771583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a059-bbf1-48d4-8895-c7634ad40e50 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.794091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.794756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.795036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.795309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.796012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:39.796342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.797707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.803143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 535/1054] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:39.808660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.813929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.814593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.814871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.815143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.815865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:39.816201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.818203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.834311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 520/1055] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:39.835235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.915842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3272-9cde-4923-8ae8-33258912afb7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.932067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.943861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e25ef-9bd2-4936-883f-5cc0a3922724 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:39.952815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:39.958598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.959268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.959546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.959819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.960558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] RBAC: Adding query filter params (type=image) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:39.960864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.962243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:39.967476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 536/1056] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:39.973382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:39.986486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:39.987272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:39.987551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:39.987813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:39.996279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:39.998028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:40.015980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:40.017011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:40.023345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 521/1057] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:16:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:40.024166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:40.084515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b3ad-4fd8-4c1b-839b-056b6dd988fe None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.126576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.127521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.127944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.128262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.129931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.131729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.137839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb3de-389d-40a5-82d7-3fb9a3640552 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.155510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 537/1058] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:16:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:40.188696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.189518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.189895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.190263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.191302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:40.191715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.193423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.219769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 522/1059] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:16:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:40.225608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:40.272965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:40.357216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6d2a-8823-4a08-b841-1a92ca23ce80 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.394222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.395046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.395321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.395589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.406962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.408439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:40.427611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:40.428772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:40.434286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:40.434286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:40.434286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:40.434286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:40.434286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 538/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:40.434807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:40.460335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:40.550569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323c23-68d6-459f-95d1-caf7e9f52241 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.590237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.590897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.591176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.591447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.592440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:40.592545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.593874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.612109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 523/1061] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:40.613878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:40.712389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:40.731025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9cdec-ec7d-44a7-b5e3-4a5f1781d79a None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.766764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.767547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.767823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.768117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.775382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.776850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:40.793452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:40.794378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:40.800143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 539/1062] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:40.802969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:40.891542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:40.913189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7616d3-36e9-4432-b3bb-a34ec89a6d40 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:40.947261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:40.948103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:40.948239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:40.948569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:40.949347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:40.949650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:40.951084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403d4a6-11f6-4572-ab5d-6ed55cf2e374 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:40.963834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 524/1063] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:40.969497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:41.075974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2a72-e124-4623-8244-194f6355e793 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:41.110817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:41.111694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:41.111970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:41.112263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/433ccd880f27469db3a436ecdc50a154` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:41.114992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=0e00c4684e0645eaa796aa1765f7481e, role_id=433ccd880f27469db3a436ecdc50a154)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:41.116458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0254c5-73bc-49fc-af57-a214efecbc8e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:41.131030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 540/1064] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:40 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/0e00c4684e0645eaa796aa1765f7481e/roles/433ccd880f27469db3a436ecdc50a154 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:41.529112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136080a7-ab01-4845-9692-fbf19cffcab4 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:41.529407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136080a7-ab01-4845-9692-fbf19cffcab4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:41.529687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136080a7-ab01-4845-9692-fbf19cffcab4 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:41.531073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 525/1065] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:41.536234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:41.536531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:41.536809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:41.542731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:41.554156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:41.556167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:41.632063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 541/1066] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:41.652752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136080a7-ab01-4845-9692-fbf19cffcab4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:41.769223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136080a7-ab01-4845-9692-fbf19cffcab4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:41.808249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:41.809401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:41.809903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:41.810383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:41.818725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:41.823045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:41.831334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:41.833190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:41.834189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:41.834843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 526/1067] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:41.840892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:41.944640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e3d0-7ab2-4e88-bcd6-7ee418caa967 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:41.981627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:41.982299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:41.982555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:41.982808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:41.983543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:41.983842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:41.985258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:41.986568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:41.999656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 542/1068] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:42.001101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.106388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5c860-feff-4bb9-b34c-53fb09c453d5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.140942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.141803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.142079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.142348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] PATH_INFO: `/v3/users/1499170b67c8447c976421e490b31245` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.156661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] RBAC: Authorizing `identity:get_user(user_id=1499170b67c8447c976421e490b31245)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.158102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ad43a-8b26-4a82-a060-5e5fbb933bae None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.164581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 527/1069] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/users/1499170b67c8447c976421e490b31245 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:42.166561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.267279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0a3c-b4c2-46c5-a2f0-180bac918aea None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.267566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0a3c-b4c2-46c5-a2f0-180bac918aea None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.267848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0a3c-b4c2-46c5-a2f0-180bac918aea None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.269264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 528/1070] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:42.274248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.274533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.274811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.279483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8af2e-4ef1-45f4-b0b5-294510585b71 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.292982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:42.294172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:42.319729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.320761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.321048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.321328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.354015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:42.368840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 529/1071] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:16:42.386306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:42.391271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.396284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.397752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.498063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d992a-ef46-4ee2-871f-35644eee702e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.499186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 543/1072] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 14:16:42.505238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.534083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.534847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.535143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.535426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.596315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:42.607209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:42.611430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.613107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.614351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b60d2d-a358-4316-998d-83529179d978 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.649838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.650606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.650886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.651154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.652346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.653781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.655482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 544/1073] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:42.661964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.724329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 530/1074] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 14:16:42.730272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.771917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0866ba-12ce-457e-8892-cf2d6349b25b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.808162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.808820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.809101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.809372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.810208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=6f3795617c744dc5acbc24720a1b8659, user.id=1499170b67c8447c976421e490b31245) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:42.810583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.811955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.817953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 545/1075] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/role_assignments?user.id=1499170b67c8447c976421e490b31245&scope.project.id=6f3795617c744dc5acbc24720a1b8659&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:42.835006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0b912-045f-4140-86b0-7097711adfe0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:42.868401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:42.876866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:42.877762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:42.878087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:42.878460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:42.891531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:42.893062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e8c7ead2-41ae-41fb-903a-78f69379767d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:42.912470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:42.913399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:42.914290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:42.914290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:42.914290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:42.914290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:42.915250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 531/1076] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:42.919993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:42.950115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:43.027094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b490-6aeb-4085-86c7-e5e8facec926 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:43.062738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:43.063395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.063670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.063938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.064674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:43.064975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:43.066329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75840f7-ded6-46f6-8dbf-bf0026b4cf1c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:43.084039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 546/1077] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:43.178801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552865-5735-47e3-a186-bf272832ed08 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.179303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552865-5735-47e3-a186-bf272832ed08 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.179303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67552865-5735-47e3-a186-bf272832ed08 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.180821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 532/1078] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:43.186136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.186425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.186694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.205211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:43.206400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:43.290777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 547/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:43.315027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67552865-5735-47e3-a186-bf272832ed08 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:43.425191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67552865-5735-47e3-a186-bf272832ed08 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:43.461041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:43.461742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.462023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.462299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.469949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:43.473223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:43.482310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:43.483249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 14:16:43.484097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:43.484992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 533/1080] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Jun 24 14:16:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:43.490195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:43.508730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:43.587508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f2c06-3b70-427f-b408-3d0ac3d066df None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:43.620404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:43.621059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.621337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.621721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.622348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:43.622650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:43.624035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:43.632176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 548/1081] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:16:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:43.637896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:43.736784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06283d8-c809-4db1-b9ea-caf9e13515dc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:43.770421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:43.771200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.771473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.771739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.782371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:43.783804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:43.801947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:43.802976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:43.803882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:43.803882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:43.803882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:43.803882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:43.803882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 534/1082] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:43.808903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:43.887526 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:43.912740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f9ac-17e6-493f-b509-4a16502276ff None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:43.955840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:43.956522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:43.956802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:43.958846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:43.958846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:43.959040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:43.960375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:43.972543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 549/1083] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:43.978902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.031391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:44.078976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71391-7653-452f-b7eb-aebbd6aa35cb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:44.112700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:44.113507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.113786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.114055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.121471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:44.122915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:16:44.136566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:44.137473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:44.138445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 535/1084] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Jun 24 14:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:44.143564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.242955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b8b1-8fc1-46b1-8ecb-ed11e00c361e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:44.277299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:44.278096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.278372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.278630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.279459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:44.279756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:44.281207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:44.290447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:44.299212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 550/1085] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:44.305496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.403269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea814-6029-40a5-8630-720d4c0ea14e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:44.416512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:44.438501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:44.439136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.439413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.439683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.506109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:44.507551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:44.604516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 536/1086] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:44.610092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.708754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36177-cb9c-4a18-bf17-0cdd1bf6dadd None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:44.743453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:44.744265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.744539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.744803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.755058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:44.756542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-fa3f88bb-6f8b-485e-9ac2-73b0a3c811c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:16:44.774688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:44.775605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:44.776693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:16:44.776693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:16:44.776693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:16:44.776693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:44.776693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 551/1087] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:44.781440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.796074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:44.852579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa091a48-76f4-4667-980d-cf16841037c4 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.852865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa091a48-76f4-4667-980d-cf16841037c4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.853142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa091a48-76f4-4667-980d-cf16841037c4 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.854600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 552/1088] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:44.859670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.860039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.860411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.876562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:44.877737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:44.881138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84143-7c6d-46ab-9f33-0e61bf4d4ece None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:44.915763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:44.916446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:44.916731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:44.917015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:44.917760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:44.918065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:44.919437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:44.923521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:44.930895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 537/1089] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:44.936913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:44.944682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 553/1090] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:44.967416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.006059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:45.036528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c296cd-5b00-4a03-839e-221049178e82 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.069734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255148-adc2-4707-a4e6-31ad8a7e63eb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.071291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.072103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.072380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.072650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.079413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.080883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:16:45.094790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:45.095695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:45.097065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 538/1091] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:45.102168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.103237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.104040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.104324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.104598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.115786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:45.123440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:45.124610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 554/1092] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:16:45.131263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.171512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:45.207781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2010d-f976-4f7b-a692-cbb171462187 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.230364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd8a0d-6d52-4196-b5e7-554fdfbdc2a8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.239533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:45.244938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.245595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.245868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.246139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.247203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:45.247500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.248961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.260765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 539/1093] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:45.266953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.270536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.271278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.271569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.271847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.272757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:45.273305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.276389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.290862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 555/1094] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:45.296675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.369405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b348-0c34-4346-972f-5efb2c411ec4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.396994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79b765-19e2-43ec-a7b2-93338970e787 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.398562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:45.403989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.404634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.404915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.405191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.406028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] RBAC: Adding query filter params (role.id=433ccd880f27469db3a436ecdc50a154, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=0e00c4684e0645eaa796aa1765f7481e) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:45.406338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.407788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.413712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 540/1095] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:45 2022] GET /identity/v3/role_assignments?user.id=0e00c4684e0645eaa796aa1765f7481e&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=433ccd880f27469db3a436ecdc50a154 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:45.432586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.433478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.433753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.434022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] PATH_INFO: `/v3/users/1499170b67c8447c976421e490b31245` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.435955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] RBAC: Authorizing `identity:get_user(user_id=1499170b67c8447c976421e490b31245)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.437465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.439200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 556/1096] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:45 2022] GET /identity/v3/users/1499170b67c8447c976421e490b31245 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:16:45.445792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.507725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:45.553604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfad16-8e66-4da0-a33e-22681b744391 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.591322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.592297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.592576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.592850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.594041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.595472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fab2f-8282-4dac-adea-41efaa77c008 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.597250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 541/1097] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:16:45 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:45.603576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:45.711969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2544ee-cb83-4ded-a3ac-201a95b97806 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:45.746843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:45.747969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:45.748273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:45.748543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659/users/1499170b67c8447c976421e490b31245/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:45.750469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3795617c744dc5acbc24720a1b8659, user_id=1499170b67c8447c976421e490b31245, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:45.751890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac41c88-2202-4fe3-96f9-988f3b039d21 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:45.765427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 557/1098] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:45 2022] PUT /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659/users/1499170b67c8447c976421e490b31245/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:47.775264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c66cd-a64b-4635-88b8-ac23e72c4f0c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:47.775890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c66cd-a64b-4635-88b8-ac23e72c4f0c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:47.775890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c66cd-a64b-4635-88b8-ac23e72c4f0c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:47.777217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 542/1099] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:47.782454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:47.782904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:47.783005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:47.799236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:47.800448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:47.824302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:47.866984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 558/1100] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:47.891475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c66cd-a64b-4635-88b8-ac23e72c4f0c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:47.992676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c66cd-a64b-4635-88b8-ac23e72c4f0c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.017960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:48.028777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.029563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.029843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.030117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.040462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:16:48.048463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:16:48.049603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:16:48.051192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 543/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:16:48.056353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:48.154793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aef4b-0a19-4518-bda7-97b9ba930e54 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.188125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.188773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.189051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.189320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.190047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:48.190344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:48.191739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:48.199564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 559/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:48.205341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:48.309880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca0517-af83-4425-9deb-09b4c34ae5ec None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.347053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.348456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.348738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.349011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] PATH_INFO: `/v3/users/1499170b67c8447c976421e490b31245` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.350440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] RBAC: Authorizing `identity:get_user(user_id=1499170b67c8447c976421e490b31245)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:48.351878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:48.353527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 544/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:48 2022] GET /identity/v3/users/1499170b67c8447c976421e490b31245 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:48.359501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:48.384121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:48.456377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c27ad-3f83-495a-a3d1-1938894bc91d None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.489232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.489857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.490134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.490404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.554724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:48.556287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:48.578472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:48.652982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 560/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:48.658776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:48.710567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:48.756165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f34c4-9fa0-4856-846c-9fa3a731137f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.788971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.789790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.790061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.790324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.791465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:48.792909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376655e9-8797-409c-8dfc-6826547ac9d4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:48.794562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 545/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:16:48 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:48.801208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:48.896778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa52a2-c731-4fc5-8345-caf046a8d2b9 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:48.919091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:48.931169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:48.931807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:48.932119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:48.932398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:48.933217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=6f3795617c744dc5acbc24720a1b8659, user.id=1499170b67c8447c976421e490b31245) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:48.933529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:48.934966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c1fe6-690a-4896-a6f5-4ed9a096e4e6 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:48.940869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 561/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:48 2022] GET /identity/v3/role_assignments?user.id=1499170b67c8447c976421e490b31245&scope.project.id=6f3795617c744dc5acbc24720a1b8659&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:51.010896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686fa7-2bc8-45e9-af97-20126dac905a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:51.011478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686fa7-2bc8-45e9-af97-20126dac905a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:51.011478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686fa7-2bc8-45e9-af97-20126dac905a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:51.012883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 546/1107] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:16:51.018333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:51.018786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:51.018885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:51.036802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:51.038009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:51.109820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 562/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:51.135692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686fa7-2bc8-45e9-af97-20126dac905a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:51.248758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686fa7-2bc8-45e9-af97-20126dac905a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:51.270298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:51.284522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:51.285860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:51.286135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:51.286401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:51.287569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:51.289031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985cac-c57b-4265-841a-23ff6fce9002 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:51.290629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 547/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:51.296886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:51.396451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94894-0e57-4f9a-9daf-0b374d4863a6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:51.413740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:51.432276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:51.432940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:51.433217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:51.433486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:51.434182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:51.435763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925df5-0298-4849-931e-881a2a40b4c2 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:51.455621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 563/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:16:51 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:16:53.555988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d245e3-244d-46f1-a2ff-a3261aededf6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:53.556568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d245e3-244d-46f1-a2ff-a3261aededf6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:53.556568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d245e3-244d-46f1-a2ff-a3261aededf6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:53.557941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 548/1111] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:53.563310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:53.563763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:53.563869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:53.581409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:53.582692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:53.651962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 564/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:53.676351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d245e3-244d-46f1-a2ff-a3261aededf6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:53.786442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d245e3-244d-46f1-a2ff-a3261aededf6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:53.822398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:53.823157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:53.823431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:53.823701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] PATH_INFO: `/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:53.825184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] RBAC: Authorizing `identity:get_role(role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:53.826588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:53.828045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 549/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:53 2022] GET /identity/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:53.834289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:53.936960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c572-1aa8-418d-8c0a-a7099e63d640 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:53.938569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:53.974848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:53.976487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:53.976904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:53.977188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] PATH_INFO: `/v3/users/9cba0d25b40f4e04afea637196a091e5` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:53.991354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] RBAC: Authorizing `identity:get_user(user_id=9cba0d25b40f4e04afea637196a091e5)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:53.992877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:53.994666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 565/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:53 2022] GET /identity/v3/users/9cba0d25b40f4e04afea637196a091e5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:54.000618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:54.061533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:54.107826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11150b5a-6fc8-46d9-82cd-5a6cd5fa53dc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:54.142485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:54.143135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:54.143412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:54.143683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:54.213757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:54.215224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:54.275026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:54.320658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 550/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:16:54.326904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:54.433940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b65488-d031-4e7d-8a6f-50a1dbe2377f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:54.467982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:54.468871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:54.469150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:54.469420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:54.471261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:54.472083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45845f9-aa83-46f3-874f-6b58b414bbba None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:54.474331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 566/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:16:54 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:54.480805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:54.583743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750aa2-2f28-4976-a845-bd1b5c16f1f1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:54.621272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:54.622036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:54.622331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:54.622745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:54.623580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=6f3795617c744dc5acbc24720a1b8659, user.id=9cba0d25b40f4e04afea637196a091e5) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:16:54.623890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:54.625381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8517ea-ab78-4140-9af7-2e21186ba9a1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:54.631259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 551/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:16:54 2022] GET /identity/v3/role_assignments?user.id=9cba0d25b40f4e04afea637196a091e5&scope.project.id=6f3795617c744dc5acbc24720a1b8659&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:56.680046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff1c1-f9db-4cc0-b666-817b1f48127f None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:56.680622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff1c1-f9db-4cc0-b666-817b1f48127f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:56.680622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff1c1-f9db-4cc0-b666-817b1f48127f None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:56.681966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 567/1118] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:56.687616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:56.688101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:56.688196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:56.706358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:56.708405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:56.723916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:56.778508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 552/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:56.801854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff1c1-f9db-4cc0-b666-817b1f48127f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:56.830455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:56.904814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff1c1-f9db-4cc0-b666-817b1f48127f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:56.938924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:56.939688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:56.939965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:56.940264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] PATH_INFO: `/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:56.942357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] RBAC: Authorizing `identity:get_role(role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:56.943731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:56.945148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 568/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:56 2022] GET /identity/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:56.951444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:57.052155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe71017-f6fd-431c-bf24-6059a1e8e564 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:57.086606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:57.087476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:57.087755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:57.088040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] PATH_INFO: `/v3/users/9cba0d25b40f4e04afea637196a091e5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:57.089242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] RBAC: Authorizing `identity:get_user(user_id=9cba0d25b40f4e04afea637196a091e5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:57.090713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:57.092389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 553/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:56 2022] GET /identity/v3/users/9cba0d25b40f4e04afea637196a091e5 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:57.098982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:57.195511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:57.202374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce50729-d6ef-4c8f-b6c3-40f98499877c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:57.238572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:57.239827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:57.240229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:57.240501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:57.241699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:57.243130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271d38d-f838-4bc2-81fe-b876d3ad6b2f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:57.244858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 569/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:16:57 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:57.250767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:57.270932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:57.351516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65d4fe-2cbc-45b0-becd-adeb627af82c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:57.385578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:57.386464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:57.386739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:57.387009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659/users/9cba0d25b40f4e04afea637196a091e5/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:57.389356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3795617c744dc5acbc24720a1b8659, user_id=9cba0d25b40f4e04afea637196a091e5, role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:57.390783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ba23a-b41b-4e02-adc4-403af64a4ea6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:57.405038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 554/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:16:57 2022] PUT /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659/users/9cba0d25b40f4e04afea637196a091e5/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:16:59.422924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0761ab-cd3a-4daf-8284-daece347bff5 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:59.423444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0761ab-cd3a-4daf-8284-daece347bff5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:59.423557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0761ab-cd3a-4daf-8284-daece347bff5 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:59.424955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 570/1124] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:16:59.430161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:59.430535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:59.430708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:59.448513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:16:59.449895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:16:59.515890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 555/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:16:59.540011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0761ab-cd3a-4daf-8284-daece347bff5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:59.637466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0761ab-cd3a-4daf-8284-daece347bff5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:59.669572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:59.670403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:59.670680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:59.670950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] PATH_INFO: `/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:59.672453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] RBAC: Authorizing `identity:get_role(role_id=50f8ce44cb0247a3a2f8278a7e5f2ced)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:59.673815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:59.675752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 571/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:59 2022] GET /identity/v3/roles/50f8ce44cb0247a3a2f8278a7e5f2ced => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:59.681549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:59.691758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:59.781633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58651cd-af7b-431c-ba8f-3e41f79bc856 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:59.814466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:59.815317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:59.815656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:59.815930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] PATH_INFO: `/v3/users/9cba0d25b40f4e04afea637196a091e5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:16:59.817126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=9cba0d25b40f4e04afea637196a091e5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:16:59.818547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:16:59.820182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 556/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:16:59 2022] GET /identity/v3/users/9cba0d25b40f4e04afea637196a091e5 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:16:59.825925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:16:59.857499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:16:59.926015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff795b-3b7c-4ad6-941d-9a77d0422f17 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:16:59.958896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:16:59.959525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:16:59.959801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:16:59.960092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:00.026290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:00.027848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:00.056524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:00.123800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 572/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:16:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:00.130409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:00.205896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:00.231844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba860cb-dd36-4f32-83ac-b89b2cdd6cc2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:00.265537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:00.266381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:00.266660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:00.266928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] PATH_INFO: `/v3/projects/6f3795617c744dc5acbc24720a1b8659` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:00.268101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] RBAC: Authorizing `identity:get_project(project_id=6f3795617c744dc5acbc24720a1b8659)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:00.270185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2f642-1a7f-4403-ba86-5657ab6b16bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:00.271928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 557/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:00 2022] GET /identity/v3/projects/6f3795617c744dc5acbc24720a1b8659 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:00.278130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:00.379494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e913-5ea8-4086-8d31-51087b6d15e0 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:00.408483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:00.414264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:00.414906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:00.415181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:00.415451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:00.416294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] RBAC: Adding query filter params (role.id=50f8ce44cb0247a3a2f8278a7e5f2ced, scope.project.id=6f3795617c744dc5acbc24720a1b8659, user.id=9cba0d25b40f4e04afea637196a091e5) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:00.416602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:00.418031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73bb34-1117-4132-b340-a40806eaa879 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:00.423703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 573/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:17:00 2022] GET /identity/v3/role_assignments?user.id=9cba0d25b40f4e04afea637196a091e5&scope.project.id=6f3795617c744dc5acbc24720a1b8659&role.id=50f8ce44cb0247a3a2f8278a7e5f2ced => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:02.445880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73450-c812-4a0b-a212-bd6bc816ad02 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:02.446421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73450-c812-4a0b-a212-bd6bc816ad02 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:02.446421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73450-c812-4a0b-a212-bd6bc816ad02 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:02.447767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 558/1131] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:02.452974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:02.453387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:02.453529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:02.471084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:02.472237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:02.536774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 574/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:02.560102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73450-c812-4a0b-a212-bd6bc816ad02 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:02.660788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73450-c812-4a0b-a212-bd6bc816ad02 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:02.693557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:02.694324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:02.694602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:02.694872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:02.696050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:02.697489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5f7f-1f2d-45d5-9c57-984f9020f320 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:02.699323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 559/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:17:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:02.705092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:02.804314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e71a7b-27e4-43ef-ac51-f794b57d02d2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:02.829761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:02.839256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:02.839907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:02.840230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:02.840502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:02.841198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:02.842631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4e214-0034-4dfc-a5ef-a56808c0c8fe None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:02.870854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 575/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:17:02 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:17:04.989542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb240a-e992-458e-9135-a37fcc108a45 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:04.990106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb240a-e992-458e-9135-a37fcc108a45 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:04.990106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb240a-e992-458e-9135-a37fcc108a45 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:04.991476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 560/1135] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:17:04.996950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:04.997413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:04.997517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:05.014199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:05.015381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:05.080892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 576/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:05.107242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb240a-e992-458e-9135-a37fcc108a45 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:05.121999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:05.211383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb240a-e992-458e-9135-a37fcc108a45 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:05.246087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:05.246781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:05.247059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:05.247336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:05.248697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:05.250148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941f7c-418f-4b79-b36e-ce88f2d1cb48 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:05.251774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 561/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:17:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:05.257607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:05.354700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61f04c-4404-45cd-903e-b39d2126e42e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:05.364546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:05.390806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:05.391471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:05.391755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:05.392054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:05.392766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:05.394241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eb722-e3c8-4932-b2b1-66174d83abba None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:05.413904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 577/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:17:05 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:17:07.524844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89e35-1a53-483c-a2aa-73c2e5af3e00 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:07.525351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89e35-1a53-483c-a2aa-73c2e5af3e00 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:07.525351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b89e35-1a53-483c-a2aa-73c2e5af3e00 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:07.526643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 562/1139] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:07.531777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:07.532232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:07.532370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:07.549347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:07.550550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:07.618663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 578/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:07.642440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b89e35-1a53-483c-a2aa-73c2e5af3e00 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:07.743542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:07.765796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b89e35-1a53-483c-a2aa-73c2e5af3e00 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:07.802368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:07.803155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:07.803445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:07.803712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:07.815114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:07.823319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:07.824816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:07.826121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 563/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:07.830733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:07.922159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:07.929518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d801c-7239-4f07-b45f-a06f617fc70c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:07.963654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:07.964340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:07.964624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:07.964898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:07.965642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:07.965942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:07.967320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:07.977398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 579/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:07.984922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:08.086364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a612a8-6621-4382-9c81-2d9b58789d46 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:08.121340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:08.122221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:08.122501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:08.122781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] PATH_INFO: `/v3/users/567f9c16502e486fac5e8b402c35873c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:08.134447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:08.138259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] RBAC: Authorizing `identity:get_user(user_id=567f9c16502e486fac5e8b402c35873c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:08.139892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:08.141893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 564/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:07 2022] GET /identity/v3/users/567f9c16502e486fac5e8b402c35873c => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:08.149581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:08.256072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e764-19ed-4300-a39f-4f2637200a0c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:08.292145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:08.292799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:08.293081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:08.293355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:08.321725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:08.369796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:08.371175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:08.473599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 580/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:17:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:08.480013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:08.590150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b2678-6623-454b-a4fb-4275859e28d7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:08.629110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:08.629902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:08.630159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:08.630436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] PATH_INFO: `/v3/projects/e9747067a9d74406b53519d3592b8b01` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:08.631660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] RBAC: Authorizing `identity:get_project(project_id=e9747067a9d74406b53519d3592b8b01)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:08.633136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0af895-9cf7-40fb-842b-f6bc070c2fbf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:08.634878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 565/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:08 2022] GET /identity/v3/projects/e9747067a9d74406b53519d3592b8b01 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:08.644193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:08.702602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:08.749668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8344-fb1f-4597-b61c-77fe1e6ec628 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:08.787809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:08.788505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:08.788782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:08.789062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:08.789898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=e9747067a9d74406b53519d3592b8b01, user.id=567f9c16502e486fac5e8b402c35873c) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:08.790266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:08.791667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d9ec-0f8a-4717-bc63-181c5dc3dcb9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:08.797839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 581/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:17:08 2022] GET /identity/v3/role_assignments?user.id=567f9c16502e486fac5e8b402c35873c&scope.project.id=e9747067a9d74406b53519d3592b8b01&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:10.883666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3a2a-b90e-4763-8c3d-4888b5a8fd06 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:10.884236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3a2a-b90e-4763-8c3d-4888b5a8fd06 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:10.884236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c3a2a-b90e-4763-8c3d-4888b5a8fd06 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:10.885603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 566/1147] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:10.890803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:10.891236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:10.891359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:10.907909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:10.909675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:10.977371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 582/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:11.000917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c3a2a-b90e-4763-8c3d-4888b5a8fd06 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:11.067364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:11.107528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c3a2a-b90e-4763-8c3d-4888b5a8fd06 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:11.144635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:11.145392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:11.145670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:11.146065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:11.161368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:11.169676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:11.171248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:11.172423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 567/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:11.178614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:11.255823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:11.307185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649531a2-f0ca-43e7-9afc-769dbe108e18 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:11.348365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:11.349507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:11.350273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:11.350760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:11.352220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:11.352767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:11.355073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:11.365883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 583/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:11.371881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:11.482535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0469f-8b62-4a7e-afce-5ce1ae9eb872 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:11.509885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:11.520204 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:11.521071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:11.521348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:11.521618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] PATH_INFO: `/v3/users/567f9c16502e486fac5e8b402c35873c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:11.522820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] RBAC: Authorizing `identity:get_user(user_id=567f9c16502e486fac5e8b402c35873c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:11.524357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:11.526027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 568/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:11 2022] GET /identity/v3/users/567f9c16502e486fac5e8b402c35873c => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:11.531966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:11.645328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2b4f-7d3a-410d-ad64-e8898d101a47 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:11.666964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:11.703954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:11.705203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:11.705573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:11.706485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] PATH_INFO: `/v3/projects/e9747067a9d74406b53519d3592b8b01` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:11.708692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=e9747067a9d74406b53519d3592b8b01)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:11.710920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f346937-bc22-47ae-aef8-6186f7f95fa1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:11.714085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 584/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:11 2022] GET /identity/v3/projects/e9747067a9d74406b53519d3592b8b01 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:11.722354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:11.848932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea6fb5-3466-4805-b7b3-22f6464449b3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:11.884299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:11.885182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:11.885462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:11.885739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] PATH_INFO: `/v3/projects/e9747067a9d74406b53519d3592b8b01/users/567f9c16502e486fac5e8b402c35873c/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:11.887758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9747067a9d74406b53519d3592b8b01, user_id=567f9c16502e486fac5e8b402c35873c, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:11.889237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98a81c-5fea-429a-965d-f8895831739a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:11.903385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 569/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:17:11 2022] PUT /identity/v3/projects/e9747067a9d74406b53519d3592b8b01/users/567f9c16502e486fac5e8b402c35873c/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:17:14.004805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a827b-a48a-4cf3-8b89-f6911af09734 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.005366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a827b-a48a-4cf3-8b89-f6911af09734 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.005366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a827b-a48a-4cf3-8b89-f6911af09734 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.006812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 585/1154] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:14.012165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.012649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.012751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.030094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:14.031298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:14.087687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:14.108364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 570/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:14.138825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a827b-a48a-4cf3-8b89-f6911af09734 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:14.271094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a827b-a48a-4cf3-8b89-f6911af09734 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:14.304940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:14.305789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.306064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.306354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.317227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:14.324695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:14.325788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:17:14.326632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 586/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:14.333291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:14.429945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a68ca-4fc7-4823-abd5-9719df545cf7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:14.462288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:14.462934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.463214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.463488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.464265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:14.464568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:14.465936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:14.474393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 571/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:14.480389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:14.522884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:14.579065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03764dbf-bc5f-468b-b66e-ef079a8b37a3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:14.612373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:14.613231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.613507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.613776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] PATH_INFO: `/v3/users/567f9c16502e486fac5e8b402c35873c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.614958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] RBAC: Authorizing `identity:get_user(user_id=567f9c16502e486fac5e8b402c35873c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:14.616426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:14.618042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 587/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:14 2022] GET /identity/v3/users/567f9c16502e486fac5e8b402c35873c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:14.623934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:14.670422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:14.723842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ab50-11c1-47e0-85c8-17e1f599ba05 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:14.757535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:14.758168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:14.758447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:14.758778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:14.826000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:14.827451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:14.873036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:14.928035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 572/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:17:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:14.934209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:15.030025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf7c7-f69f-4a97-857e-dae2900ca051 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:15.039551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:15.066715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:15.067579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:15.067859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:15.068156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] PATH_INFO: `/v3/projects/e9747067a9d74406b53519d3592b8b01` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:15.069967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] RBAC: Authorizing `identity:get_project(project_id=e9747067a9d74406b53519d3592b8b01)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:15.071706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f217-5be3-4d27-92e6-b6643086d977 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:15.074000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 588/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:14 2022] GET /identity/v3/projects/e9747067a9d74406b53519d3592b8b01 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:15.080936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:15.180181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa013-867d-4676-8ec4-c5ec8d039047 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:15.212994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:15.213648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:15.213927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:15.214202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:15.215039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=e9747067a9d74406b53519d3592b8b01, user.id=567f9c16502e486fac5e8b402c35873c) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:15.215383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:15.216852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbcfed-8481-4863-b05b-6b7ab83a2f5e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:15.223504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 573/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:17:15 2022] GET /identity/v3/role_assignments?user.id=567f9c16502e486fac5e8b402c35873c&scope.project.id=e9747067a9d74406b53519d3592b8b01&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:17.309566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111c57f-31c1-46ba-af86-8a3ff4defb05 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:17.310172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111c57f-31c1-46ba-af86-8a3ff4defb05 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:17.310172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111c57f-31c1-46ba-af86-8a3ff4defb05 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:17.311467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 589/1162] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:17.317667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:17.318163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:17.318264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:17.336117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:17.337323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:17.340301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:17.432745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 574/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:17:17.457594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111c57f-31c1-46ba-af86-8a3ff4defb05 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:17.564366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111c57f-31c1-46ba-af86-8a3ff4defb05 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:17.598884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:17.599511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:17.600057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:17.600331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:17.644580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:17.666525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:17.667991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:17.763905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 590/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:17:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:17.769964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:17.870105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf06ff-7840-4277-933c-2abbf2c2e2a4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:17.914965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:17.915798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:17.916117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:17.916414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:17.923912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:17.926039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:17.928832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0e4f7a01-512f-412a-bb1b-8a6eb1711d03 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:17.946545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:17.948513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:17.950118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 575/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:17:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:17.954350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:18.033364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:18.056800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66603f3-ff12-4ab1-9efc-53fc827a2b2b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:18.090214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:18.090885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:18.091162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:18.091433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:18.092170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:18.092471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:18.093829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b55c7-743f-42b2-87db-086d22635927 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:18.102025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 591/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Jun 24 14:17:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:20.166805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2dad-70f9-42ef-bfdb-a5a5d8b6b7ac None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:20.167353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2dad-70f9-42ef-bfdb-a5a5d8b6b7ac None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:20.167353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2dad-70f9-42ef-bfdb-a5a5d8b6b7ac None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:20.168759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 576/1167] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:20.173816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7d5d-3251-4516-8180-d115542a7178 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:20.174746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7d5d-3251-4516-8180-d115542a7178 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:20.174907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7d5d-3251-4516-8180-d115542a7178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:20.192047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-aeaf7d5d-3251-4516-8180-d115542a7178 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:20.193219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-aeaf7d5d-3251-4516-8180-d115542a7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:20.257668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 592/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:20.281520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2dad-70f9-42ef-bfdb-a5a5d8b6b7ac None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:20.385523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2dad-70f9-42ef-bfdb-a5a5d8b6b7ac None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:20.419038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:20.419616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:20.419899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:20.420208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:20.420944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:20.422314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653f88a-6b46-4e1f-ac1d-0887846fff0c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:20.437314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 577/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Fri Jun 24 14:17:20 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:17:22.484066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6230d-06d7-4fb5-9a1d-a758c404d285 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:22.484580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6230d-06d7-4fb5-9a1d-a758c404d285 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:22.484580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6230d-06d7-4fb5-9a1d-a758c404d285 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:22.485923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 593/1170] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:22.491479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:22.491919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:22.492043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:22.509164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:22.510333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:22.565498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:22.577215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 578/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 14:17:22.600844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6230d-06d7-4fb5-9a1d-a758c404d285 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:22.672433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:22.704099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6230d-06d7-4fb5-9a1d-a758c404d285 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:22.738002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:22.738776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:22.739054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:22.739326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] PATH_INFO: `/v3/domains/433720a556424709b79689e6be14b47e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:22.749493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=433720a556424709b79689e6be14b47e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:22.750938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab004-86bf-4957-8608-26ad2a5c6b5f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:22.752619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 594/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Fri Jun 24 14:17:22 2022] GET /identity/v3/domains/433720a556424709b79689e6be14b47e => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:22.758475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:22.854459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77192-488f-494a-b73d-ccbe16bc7f84 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:22.887339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:22.887971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:22.888275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:22.888553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:22.889256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:22.890677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acd9c-ab37-4ee2-959d-ef455e774a77 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:22.914774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 579/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:17:22 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:17:24.958014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c737a2-9e94-45bc-9c1d-113d6cf1f2e2 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:24.958582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c737a2-9e94-45bc-9c1d-113d6cf1f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:24.958582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c737a2-9e94-45bc-9c1d-113d6cf1f2e2 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:24.959913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 595/1174] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:24.965043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:24.965435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:24.965595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:24.982753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:24.983919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:25.018454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:25.050682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 580/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:25.075636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c737a2-9e94-45bc-9c1d-113d6cf1f2e2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:25.179637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c737a2-9e94-45bc-9c1d-113d6cf1f2e2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:25.207256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:25.213039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:25.213919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:25.214207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:25.214660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] PATH_INFO: `/v3/domains/433720a556424709b79689e6be14b47e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:25.215939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=433720a556424709b79689e6be14b47e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:25.217413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadc5e1-cdb2-468c-bbb4-a55736eb9fc9 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:25.219056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 596/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Fri Jun 24 14:17:25 2022] GET /identity/v3/domains/433720a556424709b79689e6be14b47e => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:25.225103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:25.322220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c0425-8485-4666-86ef-a14c865ad612 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:25.355223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:25.355876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:25.356193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:25.356470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:25.357170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:25.358600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373e8d4-aa8a-47b4-a3b5-69b467a631fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:25.380982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 581/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:17:25 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:17:27.460311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2bb6-1555-43bd-a7fb-850d3a3783ca None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:27.460831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2bb6-1555-43bd-a7fb-850d3a3783ca None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:27.460831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2bb6-1555-43bd-a7fb-850d3a3783ca None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:27.462207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 597/1178] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:27.467275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:27.467692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:27.467810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:27.484979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:27.486075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:27.508494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:27.552654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 582/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:27.575998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2bb6-1555-43bd-a7fb-850d3a3783ca None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:27.676076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2bb6-1555-43bd-a7fb-850d3a3783ca None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:27.708879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:27.709665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:27.709939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:27.710205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:27.721251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:27.728919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:27.730012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:17:27.730969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 598/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:27.736312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:27.838995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7652-0d87-4808-b62d-e81d1a93af78 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:27.873972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:27.874632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:27.874915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:27.875190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:27.875934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:27.876270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:27.878274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:27.886337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 583/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:17:27.892108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:27.948269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:27.989099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b821-92a1-48df-9b9b-ce7b3022c76c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:28.021327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539d4c-b741-4111-9942-a272407c594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:28.022178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d4c-b741-4111-9942-a272407c594f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:28.022458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d4c-b741-4111-9942-a272407c594f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:28.022729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d4c-b741-4111-9942-a272407c594f None admin] PATH_INFO: `/v3/users/e4df57a324394ce08e7e477f0cfa5afb` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:28.035962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539d4c-b741-4111-9942-a272407c594f None admin] RBAC: Authorizing `identity:get_user(user_id=e4df57a324394ce08e7e477f0cfa5afb)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:28.037429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539d4c-b741-4111-9942-a272407c594f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:28.039075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 599/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:27 2022] GET /identity/v3/users/e4df57a324394ce08e7e477f0cfa5afb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:28.044975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:28.067308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:28.145619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14190017-1de2-4bf4-afb6-d2d1b5090979 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:28.178943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:28.179572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:28.179853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:28.180160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:28.250145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:28.251536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:28.271758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:28.348556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 584/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:17:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:28.354619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539d4c-b741-4111-9942-a272407c594f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:28.455381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539d4c-b741-4111-9942-a272407c594f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:28.471130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:28.489463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:28.490317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:28.490601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:28.490877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] PATH_INFO: `/v3/projects/4d43818b4ec94680800840b2e4392efe` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:28.492067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] RBAC: Authorizing `identity:get_project(project_id=4d43818b4ec94680800840b2e4392efe)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:28.493503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04d87-8e78-4f51-bd30-0a4184cfd044 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:28.495201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 600/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:28 2022] GET /identity/v3/projects/4d43818b4ec94680800840b2e4392efe => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:28.501471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:28.597514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d3e0-d3fe-47cd-8754-76cc2ec421fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:28.617483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:28.632102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:28.632748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:28.633029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:28.633305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:28.634130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=4d43818b4ec94680800840b2e4392efe, user.id=e4df57a324394ce08e7e477f0cfa5afb) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:28.634440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:28.635885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba6496-7912-4c65-98e9-7180b88141a7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:28.641320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 585/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:17:28 2022] GET /identity/v3/role_assignments?user.id=e4df57a324394ce08e7e477f0cfa5afb&scope.project.id=4d43818b4ec94680800840b2e4392efe&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:30.620866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177023c-9512-47da-a599-009bc9a609e6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:30.621395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177023c-9512-47da-a599-009bc9a609e6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:30.621395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177023c-9512-47da-a599-009bc9a609e6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:30.622756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 601/1186] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:30.627929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:30.628407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:30.628508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:30.645589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:30.646769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:30.711990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 586/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:30.735127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177023c-9512-47da-a599-009bc9a609e6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:30.834760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177023c-9512-47da-a599-009bc9a609e6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:30.870036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:30.870852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:30.871307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:30.871483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:30.882178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:30.889724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:30.890818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:17:30.891835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 602/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:30.897367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:31.002436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830f88-4336-4ec7-9923-c7754c5764d9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:31.016975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:31.038764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd566477-e388-4619-9aa3-55444503567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:31.039431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd566477-e388-4619-9aa3-55444503567f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:31.039708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd566477-e388-4619-9aa3-55444503567f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:31.039978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd566477-e388-4619-9aa3-55444503567f None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:31.040741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd566477-e388-4619-9aa3-55444503567f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:31.041039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd566477-e388-4619-9aa3-55444503567f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:31.042560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd566477-e388-4619-9aa3-55444503567f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:31.054378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 587/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:31.057019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:31.104578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:31.158666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6d98a-35cb-42a2-b83f-35220d0a34c3 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:31.191658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:31.192542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:31.192820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:31.193087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] PATH_INFO: `/v3/users/e4df57a324394ce08e7e477f0cfa5afb` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:31.194248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] RBAC: Authorizing `identity:get_user(user_id=e4df57a324394ce08e7e477f0cfa5afb)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:31.195676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:31.197302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 603/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:31 2022] GET /identity/v3/users/e4df57a324394ce08e7e477f0cfa5afb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:31.203319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd566477-e388-4619-9aa3-55444503567f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:31.302955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd566477-e388-4619-9aa3-55444503567f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:31.335351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:31.336221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:31.336496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:31.336767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] PATH_INFO: `/v3/projects/4d43818b4ec94680800840b2e4392efe` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:31.337958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d43818b4ec94680800840b2e4392efe)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:31.339385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971928c-05c4-4a92-beee-8bac15de82b5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:31.341094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 588/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:31 2022] GET /identity/v3/projects/4d43818b4ec94680800840b2e4392efe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:31.346971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:31.446311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e35083-32e5-4aae-b946-224df34209bc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:31.458454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:31.479109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:31.479981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:31.480289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:31.480565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] PATH_INFO: `/v3/projects/4d43818b4ec94680800840b2e4392efe/users/e4df57a324394ce08e7e477f0cfa5afb/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:31.482500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d43818b4ec94680800840b2e4392efe, user_id=e4df57a324394ce08e7e477f0cfa5afb, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:31.483934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2d60-5406-41a9-a577-8dd1b02c7107 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:31.496940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 604/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:17:31 2022] PUT /identity/v3/projects/4d43818b4ec94680800840b2e4392efe/users/e4df57a324394ce08e7e477f0cfa5afb/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:17:33.502686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cea7-16fc-4cf9-a877-ba8057ac1a96 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:33.503203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cea7-16fc-4cf9-a877-ba8057ac1a96 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:33.503203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cea7-16fc-4cf9-a877-ba8057ac1a96 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:33.504555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 589/1193] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:17:33.513524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:33.513996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:33.514093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:33.530738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:17:33.531919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:17:33.598854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 605/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:17:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:17:33.622153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cea7-16fc-4cf9-a877-ba8057ac1a96 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:33.669291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:33.725261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cea7-16fc-4cf9-a877-ba8057ac1a96 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:33.756943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:33.757649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:33.757924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:33.758190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:33.768912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:17:33.776470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:17:33.777562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:17:33.778420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 590/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:17:33.784356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:33.881175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85665f-3074-4c27-8a81-6c9af52cd398 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:33.882652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:33.915546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:33.916221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:33.916505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:33.916774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:33.917508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:33.917802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:33.919154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:33.926910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 606/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:17:33.932648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:34.030922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1faa7b-cdd9-4104-9f94-c30f36cfbcb2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:34.033739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:34.065211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:34.066058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:34.066336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:34.066605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] PATH_INFO: `/v3/users/e4df57a324394ce08e7e477f0cfa5afb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:34.067772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] RBAC: Authorizing `identity:get_user(user_id=e4df57a324394ce08e7e477f0cfa5afb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:34.069234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:34.070839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 591/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Jun 24 14:17:33 2022] GET /identity/v3/users/e4df57a324394ce08e7e477f0cfa5afb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:34.076626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:34.174858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de3bb7-499f-4ce6-8b67-b44536807943 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:34.206869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:34.207504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:34.207783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:34.208092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:34.240164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:34.279905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:34.281448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:34.377818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 607/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:17:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:17:34.383656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:34.481197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75f4ae-26c3-441d-a058-bcf976da315e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:34.514349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:34.515176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:34.515451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:34.515720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] PATH_INFO: `/v3/projects/4d43818b4ec94680800840b2e4392efe` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:34.516964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] RBAC: Authorizing `identity:get_project(project_id=4d43818b4ec94680800840b2e4392efe)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:34.518447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dbdef-d351-47d3-80b9-6996be59ee76 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:34.520289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 592/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Jun 24 14:17:34 2022] GET /identity/v3/projects/4d43818b4ec94680800840b2e4392efe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:34.526748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:17:34.585935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:34.622980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b7a4-4028-43ac-a56c-744747f5f5ec None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:17:34.657007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:17:34.657648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:17:34.658463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:17:34.658739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:17:34.659564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=4d43818b4ec94680800840b2e4392efe, user.id=e4df57a324394ce08e7e477f0cfa5afb) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:17:34.659873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:17:34.661335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2e46f-3a03-4a0e-9ed8-7a7d3baf2d3a None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:17:34.667043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 608/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:17:34 2022] GET /identity/v3/role_assignments?user.id=e4df57a324394ce08e7e477f0cfa5afb&scope.project.id=4d43818b4ec94680800840b2e4392efe&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:17:44.510468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=80 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:17:44.664493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=36 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:30.145064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de1ba-48e4-4d7b-9566-cd32a5a7a50f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:30.145665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de1ba-48e4-4d7b-9566-cd32a5a7a50f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:30.145665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de1ba-48e4-4d7b-9566-cd32a5a7a50f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:30.147174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 593/1201] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:30.155950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:30.155950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:30.155950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:30.173103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:30.174739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:30.267703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 609/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:30.294310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243de1ba-48e4-4d7b-9566-cd32a5a7a50f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:30.419564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243de1ba-48e4-4d7b-9566-cd32a5a7a50f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:30.469390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:30.470254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:30.470534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:30.470905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:30.487023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:30.487023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:30.508815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:30.509930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:30.516729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:30.516729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:30.516729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:30.516729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:30.516729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 594/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:30.517296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:30.636155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bbf14-6b62-4b0c-9d2c-6e34cdd63c60 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:30.675663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:30.683292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:30.684213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:30.684624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:30.685036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:30.685891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:30.686331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:30.688921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce93938-6b6c-43a0-b984-a1c518ac5d25 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:30.702175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 610/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:30.707805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:30.777504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:30.839428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df36a-704e-4880-b658-e357aefc626e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:30.884654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:30.885602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:30.885978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:30.886272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:30.887223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:30.889051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64e423-c6a2-491b-853d-f7928944b9c8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:30.915231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 595/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Jun 24 14:18:30 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:18:33.149003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3def-3c61-4181-9698-9ae07b28fa6a None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:33.149574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3def-3c61-4181-9698-9ae07b28fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:33.149574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3def-3c61-4181-9698-9ae07b28fa6a None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:33.151012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 611/1206] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:33.157536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:33.158105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:33.158279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:33.184341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:33.185539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:33.263627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 596/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:33.290111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3def-3c61-4181-9698-9ae07b28fa6a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:33.410420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3def-3c61-4181-9698-9ae07b28fa6a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:33.448032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:33.448977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:33.449245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:33.449625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:33.466559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:33.477037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:33.479468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:33.484853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 612/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:33.487909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:33.544256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:33.619849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc5237-b8f4-4ba8-a184-cd3f3193c067 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:33.660958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:33.661599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:33.661877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:33.662155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:33.662922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:33.663214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:33.664640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:33.673927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 597/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:33.679945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:33.747151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:33.806442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96394622-d790-43e0-ad1f-e63ddabae096 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:33.844441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:33.845409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:33.845731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:33.845968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:33.858282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:33.860514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:33.880843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:33.882074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:33.882992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:33.882992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:33.882992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:33.882992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:33.882992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 613/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:33.887894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:34.010708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:34.014733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c732e25-4df3-41bb-9533-61b54c78d458 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:34.059450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:34.059450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:34.059450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:34.059450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:34.060189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:34.060509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:34.062682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:34.077226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 598/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:34.082904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:34.194720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf898395-c791-4fe3-a24c-b93f3823c53f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:34.196299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:34.234304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:34.235115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:34.235383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:34.235659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:34.243638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:34.245302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:34.261456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:34.262489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:34.263419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 614/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:34.269329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:34.378456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91834c-41c7-4daa-8cf2-5c2207869eec None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:34.416699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:34.417500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:34.417806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:34.418169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:34.419130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:34.419502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:34.421692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:34.441247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 599/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:18:34.447352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:34.563905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600234-20b2-4d9e-ae86-d60537272d76 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:34.602310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:34.602964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:34.606538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:34.606538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:34.639140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:34.689069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:34.690749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:34.815299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 615/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:18:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:18:34.821211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:34.845336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:34.946185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ee5e-0412-44be-8791-e85dbaea3f61 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:34.986090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:34.987012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:34.987295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:34.987706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:34.999877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:35.001375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:35.022077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:35.028456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:35.029529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:35.029529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:35.029529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:35.029529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:35.029529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 600/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:35.031566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:35.105251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:35.153247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627481f-244b-45b6-b93e-e92b17c45238 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:35.192893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:35.193601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:35.193919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:35.194272 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:35.195046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:35.195669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:35.196919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:35.211141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 616/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:35.219488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:35.304888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:35.343825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63345571-74fa-43eb-81dd-9bfc4a8c6d9c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:35.383506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:35.384511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:35.385866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:35.385866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:35.394718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:35.396325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:35.414458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:35.416903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:35.417890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 601/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:35.421910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:35.541266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d53c0f-fe19-4405-9f36-9ed8f9975cb8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:35.573923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:35.586463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:35.587125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:35.588439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:35.588439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:35.588652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:35.588775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:35.590211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78954f-3800-4d03-b4dc-238c590fd852 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:35.609068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 617/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:35.613076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:35.733056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fe9a7-18e7-4faa-9f40-7eb125b30273 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:35.774539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:35.782306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:35.782966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:35.783300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:35.783918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:35.784918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=c3da23fe1a18462896bc021aa76561ad) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:35.784918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:35.786287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d519cde-443b-459d-9516-76cce3513a4e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:35.793014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 602/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:18:35 2022] GET /identity/v3/role_assignments?user.id=c3da23fe1a18462896bc021aa76561ad&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:38.070959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d406-bfc2-4b0f-926c-b1beb0959963 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.071493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d406-bfc2-4b0f-926c-b1beb0959963 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.071493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d406-bfc2-4b0f-926c-b1beb0959963 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.072903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 618/1220] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:38.078664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.079101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.079216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.096167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:38.097390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:38.170707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 603/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:38.195642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d406-bfc2-4b0f-926c-b1beb0959963 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:38.310282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d406-bfc2-4b0f-926c-b1beb0959963 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:38.355312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:38.356014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.356384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.356653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.369332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:38.379262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:38.380466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:38.381451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 619/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:38.386962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:38.502640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf1b54-fa8f-4eae-a7a5-a35e1113e3d2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:38.528846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:38.541695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:38.542431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.542746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.543097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.543836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:38.544169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:38.545610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:38.554174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 604/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:18:38.560659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:38.616077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:38.693648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc4d5b-3a29-407a-bbef-bdd211b41210 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:38.745238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:38.746081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.746415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.746829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.760226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:38.761849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:38.782834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:38.783968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:38.789851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:38.789851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:38.789851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:38.789851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:38.789851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 620/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:38.790193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:38.896078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4929d-b5de-4721-972b-ac41ad2968bd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:38.936453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:38.937124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:38.937467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:38.937756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:38.938737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:38.939048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:38.940471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:38.953299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 605/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:38.959254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.060096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:39.068143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72130c-1e69-4a94-8a07-7a6fb0897dfd None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:39.104121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:39.104916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:39.105208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:39.105534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:39.113663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:39.115137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:39.130681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:39.131885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:39.132990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 621/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:39.137968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.193545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:39.250609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06faf2-6079-40f5-9a73-92466800fe43 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:39.285907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:39.286604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:39.286906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:39.287201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:39.288104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:39.288447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:39.289889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:39.307602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 606/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:39.314253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.417253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b0be1-e0f3-4b78-a013-da7be4a86a15 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:39.455682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:39.456426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:39.456711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:39.456981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:39.469668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:39.471117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:39.490259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:39.491731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:39.493061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:39.493061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:39.493061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:39.493061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:39.493061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 622/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:39.497560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.605598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e8f7-2108-46cc-b5fa-3ce196b75e83 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:39.607869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:39.642613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:39.643267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:39.643548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:39.643819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:39.644561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:39.644865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:39.646223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:39.657508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 607/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:39.663398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.674605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:39.774446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786530a-c1d8-4ebb-a22b-f134754d355c None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:39.815072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:39.815881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:39.816195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:39.816468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:39.823425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:39.824948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:39.840559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:39.841879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:39.842939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 623/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:39.849061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:39.965577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c989e-57c7-4932-9976-1a40c06296bd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:40.010702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:40.011351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:40.011633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:40.011900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:40.012714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:40.013016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:40.014495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78773fd3-117d-478f-9efb-c00ede576559 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:40.028060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 608/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:40.034153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:40.109729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:40.152399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d691-1f70-43d9-9dfb-087be7bdb680 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:40.191547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:40.192512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:40.192930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:40.193358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/c3da23fe1a18462896bc021aa76561ad/roles/fc77bb0f24e34827ae6abc629b6027b3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:40.210987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=c3da23fe1a18462896bc021aa76561ad, role_id=fc77bb0f24e34827ae6abc629b6027b3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:40.212548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6e23-55b8-4094-88c9-1dcda6463330 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:40.228747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 624/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:18:40 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/c3da23fe1a18462896bc021aa76561ad/roles/fc77bb0f24e34827ae6abc629b6027b3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:18:42.384138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f61f-36d5-46ef-963e-068ba8ad7e24 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:42.384701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f61f-36d5-46ef-963e-068ba8ad7e24 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:42.384701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f61f-36d5-46ef-963e-068ba8ad7e24 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:42.386218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 609/1233] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:42.392204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:42.392641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:42.392753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:42.410332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:42.411730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:42.485915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 625/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:42.515083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f61f-36d5-46ef-963e-068ba8ad7e24 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:42.540385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:42.622681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f61f-36d5-46ef-963e-068ba8ad7e24 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:42.656957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:42.657750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:42.658032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:42.658308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:42.668885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:42.677155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:42.678233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:42.684738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 610/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Jun 24 14:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:42.685733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:42.733840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:42.795227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af88c2-2e7c-4183-9293-09252947e520 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:42.829636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:42.830294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:42.830579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:42.830861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:42.831606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:42.831910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:42.833324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:42.842018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 626/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Jun 24 14:18:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:42.848287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:42.939165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:42.963498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed879cf-9577-4aad-b6da-fb285e4e486a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:42.999500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:43.000326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:43.000612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:43.000891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:43.013116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:43.015191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:43.032474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:43.033540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:43.034648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:43.034648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:43.034648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:43.034648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:43.034648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 611/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:43.039429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:43.151131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47389b5-d29f-4e22-ab98-e8e40c8a7ca8 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:43.160991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:43.186764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:43.187432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:43.187714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:43.187987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:43.188799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:43.189101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:43.190470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:43.202065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 627/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:43.208580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:43.318636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecdec6-48b8-43ac-84cd-6f2acf655866 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:43.357836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:43.358834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:43.359225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:43.359570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:43.362630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:43.367823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:43.369798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:43.385066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:43.386564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:43.387517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 612/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:43.392832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:43.506130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512763cf-7a1e-4f9d-b5b6-4534aea798a1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:43.539980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:43.540669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:43.540958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:43.541270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:43.542063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:43.542373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:43.543802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:43.560922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 628/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:43.566767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:43.677690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fd72f-9a49-4388-8d2f-94447f956579 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:43.712460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:43.713083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:43.713360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:43.713632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:43.791802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:43.801231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:43.802693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:43.917792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 613/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:18:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:18:43.924345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:43.955271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:44.035830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd074c-6f94-4d2a-85e5-9cb1c8028b40 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:44.071659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:44.072385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:44.072664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:44.072935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:44.084837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:44.086625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:44.106031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:44.107162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:44.108834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:44.108834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:44.108834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:44.108834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:44.108834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 629/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:44.113932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:44.218522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:44.225468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250825-8e17-472e-9fe8-eeeee012c876 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:44.263654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:44.264963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:44.265217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:44.265532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:44.266360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:44.266708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:44.268192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:44.280934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 614/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:44.286827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:44.380671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:44.407912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359fcc0-80a8-4524-bfff-a0e435261b5e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:44.446186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:44.447091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:44.447510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:44.447848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:44.455242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:44.456866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:44.472600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:44.473923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:44.474874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 630/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:44.481163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:44.591891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a554-0675-4d37-80ed-671268414cc6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:44.632238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:44.632238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:44.632238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:44.632238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:44.635645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:44.635645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:44.635645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3361f9e-b05e-4197-be29-b7c36bb907f1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:44.654714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 615/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:44.657657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:44.778824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8074e-f8cb-4a5d-97ed-3ffcd51d9051 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:44.818118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:44.818845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:44.819062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:44.819335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:44.820312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] RBAC: Adding query filter params (role.id=fc77bb0f24e34827ae6abc629b6027b3, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=c3da23fe1a18462896bc021aa76561ad) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:44.820609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:44.822052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c376-46ed-4486-9b6b-aa7dd0e22a86 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:44.828627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 631/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:18:44 2022] GET /identity/v3/role_assignments?user.id=c3da23fe1a18462896bc021aa76561ad&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=fc77bb0f24e34827ae6abc629b6027b3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:46.993325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff698-d247-4756-9a24-9364335f3ce9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:46.993909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff698-d247-4756-9a24-9364335f3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:46.993909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff698-d247-4756-9a24-9364335f3ce9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:46.995346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 616/1247] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:47.000841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:47.001308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:47.001421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:47.006806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:47.020895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:47.022082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:47.098223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 632/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:47.122843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff698-d247-4756-9a24-9364335f3ce9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:47.144083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:47.249619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff698-d247-4756-9a24-9364335f3ce9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:47.287254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:47.288133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:47.288483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:47.288742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:47.299524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:47.307835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:47.309065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:47.310035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 617/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:47.315013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:47.423771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9288837-86e1-4dc6-8fcc-c162ce955dd6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:47.456065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:47.462028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:47.462701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:47.462982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:47.463254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:47.463995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:47.464326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:47.465728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:47.475952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 633/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:47.484042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:47.577928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:47.603836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe032-e39c-4457-8568-5b4414951fc6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:47.643198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:47.644099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:47.644384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:47.644658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:47.657400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:47.658854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:47.677603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:47.678753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:47.679940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:47.679940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:47.679940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:47.679940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:47.679940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 618/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:47.684917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:47.809305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104d70-cc8c-4fe8-8745-2cc8679a3ec1 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:47.849394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:47.849980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:47.850267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:47.850539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:47.851258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:47.851557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:47.852994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:47.865130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 634/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:47.871422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:47.989568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fddc9d-f44e-4c98-a72d-03462d54d417 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:48.019682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:48.028719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:48.029520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:48.030368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:48.030764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:48.042983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:48.044661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:48.065591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:48.066626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:48.067548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 619/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:48.075995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:48.149068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:48.199276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e43b8-dccd-48a7-91dc-7a39ef2f609e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:48.246102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:48.246774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:48.247060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:48.247366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:48.248371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:48.248875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:48.250388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:48.274023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 635/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:48.275280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:48.388225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4ec-6119-423b-b313-ae6dd834fc1e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:48.428354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:48.429026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:48.429218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:48.429494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:48.492139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:48.506760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:48.508524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:48.615907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 620/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:18:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:18:48.621697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:48.735016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5466fe-7fa9-4492-8bff-917516456ed7 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:48.750158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:48.776196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:48.777145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:48.777422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:48.777695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:48.789765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:48.791546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:48.813626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:48.814971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:48.815887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:48.815887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:48.815887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:48.815887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:48.815887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 636/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:48.821601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:48.925867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:48.939611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d27e3f-9638-448c-abee-2edf303bfcba None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:48.976261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:48.976939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:48.977299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:48.977561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:48.978345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:48.978646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:48.980044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:49.003617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 621/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:49.009402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:49.124344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44209c-dedd-449e-9b87-64329dbd42ea None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:49.167410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:49.168267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:49.168550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:49.168827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:49.176452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:49.177924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:49.191479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:49.192518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:49.193858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 637/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:49.198805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:49.311166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568619eb-1154-4c77-bd7d-b3d44aa3b720 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:49.345844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:49.346501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:49.346783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:49.347057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:49.347841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:49.348192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:49.349884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3c39d-8a50-457c-ae40-0ca084c0d5ba None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:49.362215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 622/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:49.368635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:49.396716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:49.481473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a4f5-e32d-4330-816a-f7b06d78adda None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:49.519924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:49.520607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:49.520904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:49.521159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:49.521994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=c3da23fe1a18462896bc021aa76561ad) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:49.522292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:49.523734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905a5e2-c1b1-432a-b3d5-a3f911e22669 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:49.529580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 638/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:18:49 2022] GET /identity/v3/role_assignments?user.id=c3da23fe1a18462896bc021aa76561ad&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:18:51.559403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955888b-c0b9-4c2f-b48b-d8aa4cd8fdb3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:51.559931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955888b-c0b9-4c2f-b48b-d8aa4cd8fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:51.559931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955888b-c0b9-4c2f-b48b-d8aa4cd8fdb3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:51.561958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 623/1261] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:51.567081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:51.567500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:51.567626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:51.584442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:51.585666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:51.649676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 639/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:51.671849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955888b-c0b9-4c2f-b48b-d8aa4cd8fdb3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:51.682442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:51.777483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955888b-c0b9-4c2f-b48b-d8aa4cd8fdb3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:51.810329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:51.811710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:51.811989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:51.812291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:51.821946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:51.829509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:51.830624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:51.831665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 624/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:51.836865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:51.854669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:51.933770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c96db-0e66-4e11-b959-5ea3f99fa06b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:51.966033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:51.966680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:51.966961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:51.967746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:51.968516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:51.968817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:51.970193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:51.978379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 640/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:51.984441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.049315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:52.083922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff27f83-a4a0-4f78-8557-18cf7a84b17c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.115910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.116714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.116993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.117264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.128699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.130139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:52.147282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:52.148440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:52.149757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:52.149757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:52.149757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:52.149757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:52.149757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 625/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:52.154187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.233972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:52.253212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456165-91eb-41dd-b977-cc8e220ca138 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.286054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.286704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.286987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.287263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.287976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:52.288318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.289689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.301427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 641/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:52.307009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.404086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4b5e6-e224-41dc-ad07-e2e80e5f901c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.423176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:52.437269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.438045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.438324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.438597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.445961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.447399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:52.461426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:52.462539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:52.463709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 626/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:52.468291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.564562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cd87-adbb-46c5-98ea-7a152c96a166 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.596396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.597043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.597323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.597594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.598412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:52.598971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.600410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.609236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:52.617752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 642/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:52.623296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.719727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aa1a7-7cf6-4dce-8f18-80e2aca28333 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.758059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.759023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.759302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.759633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.770738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.772210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:52.789087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:52.790110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:52.791189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:52.791189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:52.791189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:52.791189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:52.791189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 627/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:18:52.796656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.893193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf26b6-5a13-4e0e-933b-f06a135baabd None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:52.926244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:52.926894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:52.927175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:52.927449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:52.928190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:52.928494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:52.929860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:52.941067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 643/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:52.946620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:52.978133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:53.048364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df0c9-4368-40eb-947f-fae67a39c5e7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:53.081509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:53.082280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:53.082607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:53.082980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:53.089477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:53.090912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:53.104974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:53.106007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:53.107029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 628/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:53.112635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:53.168188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:53.209424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73aa6-0f58-41e6-b9e1-b74a0eb8e03b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:53.243910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:53.244528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:53.244806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:53.245077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:53.245844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:53.246144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:53.247559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d513-b0df-4193-97cc-34c9b6c5044c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:53.259352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 644/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:53.265899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:53.354704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:53.363562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b5e2-216c-4ef5-9a8f-1d1fd068d2e1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:53.397769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:53.398623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:53.398899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:53.399171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] PATH_INFO: `/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/c3da23fe1a18462896bc021aa76561ad/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:53.401140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=912fcc6757544c8c817b5439d78b9b05, user_id=c3da23fe1a18462896bc021aa76561ad, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:53.402566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039128a5-f184-4e00-ae90-82957be40d86 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:53.415277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 629/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Jun 24 14:18:53 2022] PUT /identity/v3/projects/912fcc6757544c8c817b5439d78b9b05/users/c3da23fe1a18462896bc021aa76561ad/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:18:55.424934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5d9e-63eb-4a5a-a150-aabb582c42b6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:55.425459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5d9e-63eb-4a5a-a150-aabb582c42b6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:55.425459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5d9e-63eb-4a5a-a150-aabb582c42b6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:55.426836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 645/1274] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:55.432136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:55.432530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:55.432679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:55.450554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:55.452259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:55.517374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 630/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:55.541622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5d9e-63eb-4a5a-a150-aabb582c42b6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:55.640472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5d9e-63eb-4a5a-a150-aabb582c42b6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:55.657047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:55.673165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:55.673937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:55.674218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:55.674492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:55.684308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:18:55.692403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:55.693491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:55.694534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 646/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Jun 24 14:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:55.699492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:55.786099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:55.806211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1994be8-dc60-4e80-8875-ed417e562c5b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:55.838860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:55.839517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:55.839799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:55.840101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:55.840845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:55.841150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:55.843028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:55.851115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 631/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Jun 24 14:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:55.856933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:55.952651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133081-1193-4d13-b27d-d222d1b7c4d5 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:55.985382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:55.986148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:55.986426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:55.986695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:55.996869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:55.998334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:56.015208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:56.016247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:56.017353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:56.017353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:56.017353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:56.017353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:56.017353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 647/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:56.022143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:56.125236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2762-a971-422f-9757-fe9b624f1d38 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:56.157104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:56.157745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:56.158028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:56.158304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:56.159018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:56.159320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:56.160715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.172635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 632/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:56.178369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:56.208073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:56.274860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cce567-9f83-444c-93e2-b15a35f36b0e None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:56.306587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:56.307364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:56.307641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:56.307913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:56.315950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:56.317416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:18:56.331663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:56.332773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:56.333930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 648/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:56.338682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:56.343033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:56.440976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5f35e-9351-4788-9323-02d193950c59 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:56.474142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:56.474798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:56.475077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:56.475350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:56.476206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:56.476515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:56.477952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.494362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 633/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:56.500556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:56.588617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:56.599201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38fa0-f68f-47cc-b37b-b3588a909a1b None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:56.631856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:56.632512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:56.632795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:56.633070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:56.697826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:56.699208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.794802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:56.805208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 649/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 14:18:56.811007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:56.879338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:56.917678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84495-ea06-4606-b4cd-45bb7351749e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:56.950198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:56.950918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:56.951733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:56.952011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:56.961703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:56.963145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:18:56.981710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:56.982765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:56.983921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:18:56.983921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:18:56.983921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:18:56.983921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:56.983921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 634/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:56.988590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:57.084853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5899a81-d8fc-4d2c-802a-744568d2f904 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:57.118012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:57.118657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:57.118934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:57.119206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:57.119915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:57.120245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:57.121602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:57.133022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 650/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Jun 24 14:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:57.138768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:57.236094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddf3be-d0fa-4cae-934c-6632fa927ea6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:57.250231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:57.270354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:57.271121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:57.271398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:57.271668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:57.278217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:57.279639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:18:57.292853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:57.293885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: ERROR keystone.server.flask.application Jun 24 14:18:57.294943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 635/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Jun 24 14:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:18:57.299954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:57.349417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:57.399157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a989f-5901-44be-8afb-c9eb0a15a4fc None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:57.431851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:57.432516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:57.432794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:57.433065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:57.433836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:57.434137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:57.436232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6261b-32af-4c3f-a4bc-95fcbfaaae0c None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:57.447724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 651/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Jun 24 14:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:18:57.454251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:57.551605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6224-5179-4b46-a85a-4d46243d198b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:57.584239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:57.584869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:57.585150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:57.585425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:57.586243 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] RBAC: Adding query filter params (role.id=2f3ba2869328424982c43c608f72cb4e, scope.project.id=912fcc6757544c8c817b5439d78b9b05, user.id=c3da23fe1a18462896bc021aa76561ad) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:18:57.586551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:57.587971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dcb3a-4122-443c-8a85-95d556d3407e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:57.593808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 636/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Jun 24 14:18:57 2022] GET /identity/v3/role_assignments?user.id=c3da23fe1a18462896bc021aa76561ad&scope.project.id=912fcc6757544c8c817b5439d78b9b05&role.id=2f3ba2869328424982c43c608f72cb4e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:18:59.649836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b748d-824d-4a6c-a27e-e153ef00ec01 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:59.650395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b748d-824d-4a6c-a27e-e153ef00ec01 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:59.650395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b748d-824d-4a6c-a27e-e153ef00ec01 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:59.651764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 652/1288] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:18:59.656902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:59.657297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:59.657461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:59.673808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:18:59.674974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:18:59.704071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:59.745915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 637/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:18:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:18:59.768669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b748d-824d-4a6c-a27e-e153ef00ec01 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:18:59.868852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b748d-824d-4a6c-a27e-e153ef00ec01 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:18:59.880422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:18:59.902739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:18:59.903469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:18:59.903747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:18:59.904043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:18:59.904712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:18:59.906081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:18:59.917570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:18:59.923879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:18:59.924992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 653/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:18:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:18:59.925989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:00.021585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeed02-af40-4314-b004-f8f26b66b005 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:00.054016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:00.054664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:00.054944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:00.055216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:00.055921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:19:00.056256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:00.057616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34421c-dfca-4fdc-873c-041e7d1bb7b6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:00.062898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 638/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Jun 24 14:18:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:19:00.068533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:00.166855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75f63-65bc-41ae-82db-1483bd48e89f None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:00.199250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:00.199896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:00.200203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:00.200480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] PATH_INFO: `/v3/services` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:00.201198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:19:00.201500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:00.202861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6600-bf11-4364-a89b-60fdcff740a4 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:00.207185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 654/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Jun 24 14:19:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:19:02.205645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27377e-9607-439a-846d-fa4fcea035e0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:02.206208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27377e-9607-439a-846d-fa4fcea035e0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:02.206208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27377e-9607-439a-846d-fa4fcea035e0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:02.207528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 639/1293] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:19:02.212690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0d54-ee01-4863-ac31-1a6ba1fc3b30 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:02.213109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0d54-ee01-4863-ac31-1a6ba1fc3b30 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:02.213223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0d54-ee01-4863-ac31-1a6ba1fc3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:02.230449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b97e0d54-ee01-4863-ac31-1a6ba1fc3b30 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:19:02.231649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b97e0d54-ee01-4863-ac31-1a6ba1fc3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:19:02.259249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:02.295758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 655/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:19:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:19:02.318789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27377e-9607-439a-846d-fa4fcea035e0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:02.349239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:02.417471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27377e-9607-439a-846d-fa4fcea035e0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:02.450051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:02.450696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:02.450978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:02.451250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:02.451972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:02.453354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bcf24-ac8f-441c-a85a-445e687db85d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:02.467345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 640/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Jun 24 14:19:02 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:19:04.507552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63025c5a-29f6-4aa6-9672-92ca5d46cb60 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:04.508080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63025c5a-29f6-4aa6-9672-92ca5d46cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:04.508080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63025c5a-29f6-4aa6-9672-92ca5d46cb60 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:04.509496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 656/1296] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:19:04.514847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:04.515264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:04.515429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:04.531764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:19:04.532979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:19:04.608233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 641/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:19:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:19:04.631418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63025c5a-29f6-4aa6-9672-92ca5d46cb60 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:04.741624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63025c5a-29f6-4aa6-9672-92ca5d46cb60 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:04.780159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:04.781035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:04.781324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:04.781600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:04.782251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:04.783688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:19:04.797779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:19:04.804176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:04.805186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 657/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:19:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:19:04.806085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:04.824711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:04.909844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39163f-87a0-4dc9-8865-c45846adfce4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:04.946523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:04.947175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:04.947455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:04.947730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:04.948459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:19:04.948764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:04.950142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:04.955317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 642/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Jun 24 14:19:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:19:04.961263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:04.993786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:05.063587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3c507-e6ca-44e4-a7f1-531422296944 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:05.101192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:05.101851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:05.102169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:05.102441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:05.103229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] RBAC: Adding query filter params (interface=public, service_id=795f18ab50754693a7031a032962bdb0, region_id=RegionOne) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:19:05.103533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:05.104955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc87a-1da2-4bae-932e-e6a97e41fe23 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:05.111303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 658/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Jun 24 14:19:04 2022] GET /identity/v3/endpoints?service_id=795f18ab50754693a7031a032962bdb0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:19:05.117079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:05.199048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:05.221552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0c7d-3d9b-4a80-bbf1-19541a6c5fc6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:05.256324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:05.256966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:05.257247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:05.257522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:05.258195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:05.259570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f26b-0216-4506-85cb-5b82128930cd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:05.266328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 643/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Jun 24 14:19:05 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:19:07.282145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5f6b-c52f-422a-89f1-6e9751eae131 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:07.282655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5f6b-c52f-422a-89f1-6e9751eae131 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:07.282747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5f6b-c52f-422a-89f1-6e9751eae131 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:07.284088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 659/1302] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:19:07.289093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:07.289488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:07.289645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:07.306475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:19:07.307644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:19:07.372844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 644/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:19:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 14:19:07.395801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5f6b-c52f-422a-89f1-6e9751eae131 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:07.488791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:07.495633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5f6b-c52f-422a-89f1-6e9751eae131 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:07.527891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:07.528700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:07.529528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:07.529808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:07.530447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:07.532328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:19:07.544048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:19:07.544989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application with Lock( Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: ERROR keystone.server.flask.application Jun 24 14:19:07.545852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 660/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Jun 24 14:19:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:19:07.551247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:07.625881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:07.648804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053d66-3798-4ea3-8529-a4a1d1d9d2ee None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:07.681148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:07.681791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:07.682067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:07.682337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:07.683034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:19:07.683332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:07.684713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115fe96-5128-4bfb-a94a-5dae1f97d4ae None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:07.690211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 645/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Jun 24 14:19:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:19:07.695838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:19:07.795115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f9725-95fe-49ee-9fce-88ea872cf265 None admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:19:07.827371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:19:07.828003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:19:07.828310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:19:07.828581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:19:07.829310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:19:07.830679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991971b-2a48-4987-aff3-1cb46b815b27 None admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:19:07.848028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 661/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Jun 24 14:19:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:19:17.687501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=30 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:19:17.844275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:10.227057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c7c3-688f-465c-b3aa-c1dc5c7c54ef None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:10.227569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c7c3-688f-465c-b3aa-c1dc5c7c54ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:10.227653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c7c3-688f-465c-b3aa-c1dc5c7c54ef None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:10.232359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 646/1307] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:10.234166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518382-b95c-4554-8479-8ed4be9e9d29 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:10.234602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518382-b95c-4554-8479-8ed4be9e9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:10.234703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6518382-b95c-4554-8479-8ed4be9e9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:10.382132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e6518382-b95c-4554-8479-8ed4be9e9d29 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:10.383838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e6518382-b95c-4554-8479-8ed4be9e9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:10.549643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 662/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:10.600313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:10.600637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:10.600975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:10.602342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 647/1309] 10.222.0.13 () {54 vars in 964 bytes} [Fri Jun 24 14:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:10.611012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50dc03-2c06-485b-ae6d-9e0824a21c3a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:10.611519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50dc03-2c06-485b-ae6d-9e0824a21c3a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:10.611808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50dc03-2c06-485b-ae6d-9e0824a21c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:10.716414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1e50dc03-2c06-485b-ae6d-9e0824a21c3a None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:10.717807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1e50dc03-2c06-485b-ae6d-9e0824a21c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:10.742741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:10.816991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 663/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Fri Jun 24 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:10.817605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:10.819452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:10.941012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973c56-b7c4-478b-ba7c-96adbda2f71f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:11.018298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:11.019076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:11.019426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:11.019773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:11.021524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:11.079104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:11.140543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:11.141994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101534-7965-4ead-8255-a689ab3756ae service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:11.162011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 648/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:20:13.567501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:13.568067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:13.568067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:13.569444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 664/1312] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:13.575370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac613a7-7962-4fea-8592-c86b38a25e4b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:13.575773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac613a7-7962-4fea-8592-c86b38a25e4b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:13.575919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac613a7-7962-4fea-8592-c86b38a25e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:13.661562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dac613a7-7962-4fea-8592-c86b38a25e4b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:13.662778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dac613a7-7962-4fea-8592-c86b38a25e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:13.766555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 649/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:13.805925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:13.808183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:13.916122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a4507-044b-4e04-82a0-3802ae1bc526 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:13.988499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:13.991537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:13.992395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:13.992845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:13.993306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:13.995578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:14.107562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:14.109069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b15c6-59b0-4cd9-a4d6-67feac6fb69b service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:14.128316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 665/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:16.468369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917406-e5a3-4044-9a0d-577313517fab None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:16.468875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917406-e5a3-4044-9a0d-577313517fab None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:16.468875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74917406-e5a3-4044-9a0d-577313517fab None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:16.470229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 650/1315] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:16.475526 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561a371-6a6d-45c2-8cf5-e12b6d804aba None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:16.475946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561a371-6a6d-45c2-8cf5-e12b6d804aba None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:16.476120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561a371-6a6d-45c2-8cf5-e12b6d804aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:16.538514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4561a371-6a6d-45c2-8cf5-e12b6d804aba None None] MFA Rules not processed for user `d4205fe074a44cd3a49b5486cb631936`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:16.539682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4561a371-6a6d-45c2-8cf5-e12b6d804aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:16.590442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:16.634655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 666/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:16.673965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74917406-e5a3-4044-9a0d-577313517fab None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:16.675503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-74917406-e5a3-4044-9a0d-577313517fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:16.686388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:16.782163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74917406-e5a3-4044-9a0d-577313517fab None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:16.853424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:16.854579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:16.854873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:16.855148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:16.856820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:16.917408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:16.963823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:16.965276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd7fc-ffe5-46e6-b20a-25e8115ff07b service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:16.983962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 651/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:19.538968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:19.539511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:19.539620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:19.540938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 667/1318] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:19.546215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45676-8c92-4baf-b853-e078e803341f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:19.546619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45676-8c92-4baf-b853-e078e803341f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:19.546774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45676-8c92-4baf-b853-e078e803341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:19.611049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-75d45676-8c92-4baf-b853-e078e803341f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:19.612290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-75d45676-8c92-4baf-b853-e078e803341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:19.707909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 652/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:19.750408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:19.751928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:19.854059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24737b7-7521-4fbf-b3d0-16abb1dd6e5f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:19.924598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:19.925231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:19.925504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:19.925773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:19.927412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:19.935078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:20.034104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:20.035557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b7423-0e71-4920-8132-e76c6cda55dc service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:20.059684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 668/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:22.753592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8f8e6-f828-405c-a3f8-b03347a19b93 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:22.754211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8f8e6-f828-405c-a3f8-b03347a19b93 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:22.754211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8f8e6-f828-405c-a3f8-b03347a19b93 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:22.755701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 653/1321] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:22.761237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975433-e2cc-4d0e-b448-727b157f7baa None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:22.761733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975433-e2cc-4d0e-b448-727b157f7baa None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:22.761845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975433-e2cc-4d0e-b448-727b157f7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:22.831428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bf975433-e2cc-4d0e-b448-727b157f7baa None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:22.832662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bf975433-e2cc-4d0e-b448-727b157f7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:22.892099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:22.939896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 669/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:22.993064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:22.993347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:22.993622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:22.995703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 654/1323] 10.222.0.13 () {54 vars in 964 bytes} [Fri Jun 24 14:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:23.002252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb2679-cf10-4fa9-b05c-122c67de9030 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:23.002623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb2679-cf10-4fa9-b05c-122c67de9030 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:23.002978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb2679-cf10-4fa9-b05c-122c67de9030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:23.085588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f9eb2679-cf10-4fa9-b05c-122c67de9030 None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:23.086818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f9eb2679-cf10-4fa9-b05c-122c67de9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:23.165150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 670/1324] 10.222.0.13 () {58 vars in 1061 bytes} [Fri Jun 24 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:23.174773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:23.176455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:23.195333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:23.282711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e1e74-d281-4570-8d10-7294f57cfcd6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:23.359576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:23.360144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:23.360430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:23.360710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:23.362363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:23.436175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:23.474546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:23.475999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a34b6-5124-428f-88c8-6eb37beb7803 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:23.494325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 655/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:20:25.818784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:25.819376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:25.819376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:25.820786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 671/1326] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:25.827392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0b59-0a19-4d76-85c6-77266d015617 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:25.827927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0b59-0a19-4d76-85c6-77266d015617 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:25.828008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0b59-0a19-4d76-85c6-77266d015617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:25.893027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ee7d0b59-0a19-4d76-85c6-77266d015617 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:25.894217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee7d0b59-0a19-4d76-85c6-77266d015617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:25.997513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 656/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:26.034066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:26.035643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:26.095692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:26.139605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a33b8-9d54-4b45-ae78-0a14a5ebc5d6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:26.221435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:26.222126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:26.222409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:26.222947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:26.224675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:26.330914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:26.333760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:26.335333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aa497-d458-4e6a-b2eb-51b4a4bbdcba service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:26.355134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 672/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:28.431657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:28.432303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:28.432303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:28.433672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 657/1329] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:28.438804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-38cb-44be-9e3a-d5b8d0173fdb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:28.439239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-38cb-44be-9e3a-d5b8d0173fdb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:28.439365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-38cb-44be-9e3a-d5b8d0173fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:28.503955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2b8f646f-38cb-44be-9e3a-d5b8d0173fdb None None] MFA Rules not processed for user `d4205fe074a44cd3a49b5486cb631936`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:28.505193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2b8f646f-38cb-44be-9e3a-d5b8d0173fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:28.608602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 673/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:28.648529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:28.650141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:28.684702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:28.763890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d76e0a-ee64-4732-a2a2-3184093a00ef None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:28.836767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:28.837341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:28.837615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:28.837882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:28.839526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:28.917504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:28.949161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:28.950536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7e79-6325-43de-be5b-4f929d033146 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:28.968593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 658/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:31.263866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:31.264410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:31.264525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:31.265824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 674/1332] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:31.271055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815b6b-3309-40c3-adcd-761202abb8fe None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:31.271555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815b6b-3309-40c3-adcd-761202abb8fe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:31.271651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815b6b-3309-40c3-adcd-761202abb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:31.338745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d3815b6b-3309-40c3-adcd-761202abb8fe None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:31.339966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d3815b6b-3309-40c3-adcd-761202abb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:31.436156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 659/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:31.471344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:31.473108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:31.539703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:31.574783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52658e23-3510-41e9-b9f8-596de26cd1f1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:31.647117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:31.647755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:31.648057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:31.648334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:31.649982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:31.757535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:31.758901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291018a-1d4c-4160-a7e4-f122171cb593 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:31.768774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:31.777213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 675/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:33.841007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:33.841570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:33.841570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:33.842937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 660/1335] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:33.848408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64bda-9c52-46b7-aa38-9dfd53e5c4e1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:33.848807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64bda-9c52-46b7-aa38-9dfd53e5c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:33.848965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64bda-9c52-46b7-aa38-9dfd53e5c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:33.913628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7bd64bda-9c52-46b7-aa38-9dfd53e5c4e1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:33.914845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7bd64bda-9c52-46b7-aa38-9dfd53e5c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:34.010327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 676/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:34.050216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:34.051749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:34.091333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:34.155081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e9215-cadf-4317-9866-e4a8cd6dada6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:34.227702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:34.228903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:34.229177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:34.229444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:34.231059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:34.313096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:34.338880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:34.340360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5349f-c008-410e-a1f7-c6c599727ad3 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:34.358401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 661/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:37.016830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:37.017371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:37.017371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:37.018890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 677/1338] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:37.024199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378990a-2ffd-43a3-b590-e912b0c638c4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:37.024622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378990a-2ffd-43a3-b590-e912b0c638c4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:37.024754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378990a-2ffd-43a3-b590-e912b0c638c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:37.091546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9378990a-2ffd-43a3-b590-e912b0c638c4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:37.092805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9378990a-2ffd-43a3-b590-e912b0c638c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:37.189965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 662/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:37.226164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:37.227708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:37.306180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:37.333959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ef30-379f-48a9-bee1-38eb078f3e6b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:37.405590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:37.406230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:37.406511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:37.406780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:37.408434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:37.514270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:37.515717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bac67-0b76-434f-b92b-c52cb6aeabc5 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:37.533149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 678/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:41.630144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:41.630666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:41.630773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:41.632095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 663/1341] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:41.638045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ff9b-a8c4-47bf-81b2-00b86d9ab18c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:41.638499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ff9b-a8c4-47bf-81b2-00b86d9ab18c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:41.638807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ff9b-a8c4-47bf-81b2-00b86d9ab18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:41.646437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:41.715396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d802ff9b-a8c4-47bf-81b2-00b86d9ab18c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:41.716705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d802ff9b-a8c4-47bf-81b2-00b86d9ab18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:41.822468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 679/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:41.861195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:41.863367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:41.912380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:41.959021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44737-eaa1-4bf7-81d4-8643196cd618 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:41.962671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:41.963301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:41.963578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:41.963850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:41.973333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:41.974763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e53e29-8ca2-4705-b77b-75fc106f8f0a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:41.984717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 664/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:44.679719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d4f0d-1bc5-4a50-83ce-156c0bd2bd9e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:44.680313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d4f0d-1bc5-4a50-83ce-156c0bd2bd9e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:44.680313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d4f0d-1bc5-4a50-83ce-156c0bd2bd9e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:44.682267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 680/1344] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:44.687369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366da1-c1f3-4f78-b11f-64e5b570568f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:44.687813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366da1-c1f3-4f78-b11f-64e5b570568f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:44.688054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366da1-c1f3-4f78-b11f-64e5b570568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:44.716445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4a366da1-c1f3-4f78-b11f-64e5b570568f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:44.718081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4a366da1-c1f3-4f78-b11f-64e5b570568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:44.811390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 665/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:44.850581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d4f0d-1bc5-4a50-83ce-156c0bd2bd9e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:44.862478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d4f0d-1bc5-4a50-83ce-156c0bd2bd9e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:44.866021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:44.866666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:44.866945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:44.867216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:44.877687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:44.879155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5bfeb-69e2-4b27-893c-f3d2a452a561 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:44.889720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 681/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:48.886730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ecdc-0e8d-4803-ad43-5bfadb603edd None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:48.887291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ecdc-0e8d-4803-ad43-5bfadb603edd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:48.887291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ecdc-0e8d-4803-ad43-5bfadb603edd None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:48.888749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 666/1347] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:48.894248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0986-4836-4bd4-b3a6-05e4df3e5614 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:48.894713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0986-4836-4bd4-b3a6-05e4df3e5614 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:48.894878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0986-4836-4bd4-b3a6-05e4df3e5614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:48.912221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-94ba0986-4836-4bd4-b3a6-05e4df3e5614 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:48.913428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-94ba0986-4836-4bd4-b3a6-05e4df3e5614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:48.922158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 682/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:48.959900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ecdc-0e8d-4803-ad43-5bfadb603edd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:20:48.970998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ecdc-0e8d-4803-ad43-5bfadb603edd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:20:48.974783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:20:48.975412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:48.975695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:48.975970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:48.986694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:20:48.988178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f424f6e-c8a2-41d0-bea7-a835bcab9094 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:20:48.998130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 667/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:20:53.969802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8016c-d58a-4335-a4d4-b27d7cbe6dca None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:53.970368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8016c-d58a-4335-a4d4-b27d7cbe6dca None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:53.970368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8016c-d58a-4335-a4d4-b27d7cbe6dca None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:53.972364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 683/1350] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:53.985713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332865-fcc9-4e94-b879-6fe1e1e45546 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:53.987984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332865-fcc9-4e94-b879-6fe1e1e45546 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:53.988557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec332865-fcc9-4e94-b879-6fe1e1e45546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:54.089070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ec332865-fcc9-4e94-b879-6fe1e1e45546 None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:54.090274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ec332865-fcc9-4e94-b879-6fe1e1e45546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:54.122826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:54.177702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 668/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:20:58.295978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb56a7-d7ed-41b0-a276-2eb5326f1d06 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:58.296548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb56a7-d7ed-41b0-a276-2eb5326f1d06 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:58.296548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb56a7-d7ed-41b0-a276-2eb5326f1d06 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:58.297934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 684/1352] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:58.304371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce218-a71c-4349-baa9-c9c95a4e3411 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:58.304905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce218-a71c-4349-baa9-c9c95a4e3411 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:58.304905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce218-a71c-4349-baa9-c9c95a4e3411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:58.324295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-827ce218-a71c-4349-baa9-c9c95a4e3411 None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:58.325597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-827ce218-a71c-4349-baa9-c9c95a4e3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:58.334323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 669/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:20:58.907116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=72 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:20:59.878868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932e213-a5c1-4d27-b16f-ac54cbe2fd19 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:59.879516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932e213-a5c1-4d27-b16f-ac54cbe2fd19 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:59.879516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932e213-a5c1-4d27-b16f-ac54cbe2fd19 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:59.881017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 685/1354] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:20:59.885784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518cb3-c329-4f36-b6b9-ed02207f273a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:20:59.886212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518cb3-c329-4f36-b6b9-ed02207f273a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:20:59.886451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518cb3-c329-4f36-b6b9-ed02207f273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:20:59.905328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d7518cb3-c329-4f36-b6b9-ed02207f273a None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:20:59.906631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d7518cb3-c329-4f36-b6b9-ed02207f273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:20:59.915606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 670/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:03.546342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef13-f4ef-43b5-88ae-f260c5873a3c None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:03.546875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef13-f4ef-43b5-88ae-f260c5873a3c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:03.546875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ef13-f4ef-43b5-88ae-f260c5873a3c None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:03.548567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 686/1356] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:03.553506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b29d8-5a02-4891-9d5b-c9ddbb96a3d4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:03.553931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b29d8-5a02-4891-9d5b-c9ddbb96a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:03.554088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b29d8-5a02-4891-9d5b-c9ddbb96a3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:03.572741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-516b29d8-5a02-4891-9d5b-c9ddbb96a3d4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:03.574071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-516b29d8-5a02-4891-9d5b-c9ddbb96a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:03.582367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 671/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:03.640180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233765-5b07-453d-aee3-0661d5a7a401 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:03.641418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233765-5b07-453d-aee3-0661d5a7a401 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:03.642097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233765-5b07-453d-aee3-0661d5a7a401 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:03.643749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 687/1358] 10.222.0.13 () {54 vars in 961 bytes} [Fri Jun 24 14:21:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:03.652954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e175-b9c7-4786-a2e8-d3896a4fc479 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:03.653445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e175-b9c7-4786-a2e8-d3896a4fc479 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:03.653874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e175-b9c7-4786-a2e8-d3896a4fc479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:03.709045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0853e175-b9c7-4786-a2e8-d3896a4fc479 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:03.710246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0853e175-b9c7-4786-a2e8-d3896a4fc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:03.799796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 672/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Jun 24 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:03.808461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233765-5b07-453d-aee3-0661d5a7a401 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:03.823393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233765-5b07-453d-aee3-0661d5a7a401 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:03.828690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:03.829340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:03.829748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:03.830218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:03.841159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:03.843007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01e9d-a3f1-479a-a2f0-8cbf34f6d36f service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:03.872224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 688/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:21:06.093528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6eb9-3aa3-43ea-9708-8d193f727be7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:06.094053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6eb9-3aa3-43ea-9708-8d193f727be7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:06.094151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6eb9-3aa3-43ea-9708-8d193f727be7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:06.096746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 673/1361] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:06.102738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe41e-4150-4ee9-b12a-39b506719e82 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:06.103225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe41e-4150-4ee9-b12a-39b506719e82 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:06.103311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe41e-4150-4ee9-b12a-39b506719e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:06.123575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-76efe41e-4150-4ee9-b12a-39b506719e82 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:06.125063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-76efe41e-4150-4ee9-b12a-39b506719e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:06.134040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 689/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:06.178778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6eb9-3aa3-43ea-9708-8d193f727be7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:06.193808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6eb9-3aa3-43ea-9708-8d193f727be7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:06.199150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:06.200049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:06.200049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:06.200333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:06.209018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:06.210605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd34b7-f6e3-4cf5-afa1-64ce77b56001 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:06.225570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 674/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:08.639977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594250-5817-4a5c-9f5e-32c736f4de86 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:08.640878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594250-5817-4a5c-9f5e-32c736f4de86 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:08.641339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594250-5817-4a5c-9f5e-32c736f4de86 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:08.643184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 690/1364] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:08.649825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caf11-a357-4f9e-b9af-67065082010f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:08.650578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caf11-a357-4f9e-b9af-67065082010f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:08.651174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318caf11-a357-4f9e-b9af-67065082010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:08.673820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-318caf11-a357-4f9e-b9af-67065082010f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:08.675322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-318caf11-a357-4f9e-b9af-67065082010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:08.684455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 675/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:08.731421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a2d-e4ff-4c93-850d-2766492fc6b0 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:08.731693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a2d-e4ff-4c93-850d-2766492fc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:08.731969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a2d-e4ff-4c93-850d-2766492fc6b0 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:08.733421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 691/1366] 10.222.0.13 () {54 vars in 961 bytes} [Fri Jun 24 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:08.738962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0224fd-c0a6-4243-bd84-80c5421a7229 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:08.739253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0224fd-c0a6-4243-bd84-80c5421a7229 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:08.739534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0224fd-c0a6-4243-bd84-80c5421a7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:08.757414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5a0224fd-c0a6-4243-bd84-80c5421a7229 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:08.758592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a0224fd-c0a6-4243-bd84-80c5421a7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:08.767726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 676/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Jun 24 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:08.776077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2a2d-e4ff-4c93-850d-2766492fc6b0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:08.790684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2a2d-e4ff-4c93-850d-2766492fc6b0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:08.795986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:08.796652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:08.796929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:08.797197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:08.805686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:08.807230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3d99-f734-4a4e-843b-26427642e565 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:08.816588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 692/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:21:10.951902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b421e-f4b6-439a-802f-7cafd6852ffb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:10.952492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b421e-f4b6-439a-802f-7cafd6852ffb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:10.952492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b421e-f4b6-439a-802f-7cafd6852ffb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:10.953780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 677/1369] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:10.959027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3742-4b70-44ec-a8b5-288db28c1787 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:10.959462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3742-4b70-44ec-a8b5-288db28c1787 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:10.959585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e3742-4b70-44ec-a8b5-288db28c1787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:10.980988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-880e3742-4b70-44ec-a8b5-288db28c1787 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:10.982223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-880e3742-4b70-44ec-a8b5-288db28c1787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:10.992062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 693/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:11.036401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b421e-f4b6-439a-802f-7cafd6852ffb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:11.052068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b421e-f4b6-439a-802f-7cafd6852ffb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:11.058230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:11.058887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:11.059167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:11.059441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:11.068880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:11.070456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf4ec-c3c8-4483-a9b5-1cf5d9fecc5c service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:11.080604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 678/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:11.692898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91045c-0ce6-4335-84f9-146e6e442031 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:11.693187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91045c-0ce6-4335-84f9-146e6e442031 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:11.693692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91045c-0ce6-4335-84f9-146e6e442031 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:11.695072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 694/1372] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:11.700893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0fee-92a0-40d0-9423-4a9366439ca7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:11.701187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0fee-92a0-40d0-9423-4a9366439ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:11.701462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0fee-92a0-40d0-9423-4a9366439ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:11.719819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a84b0fee-92a0-40d0-9423-4a9366439ca7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:11.721042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a84b0fee-92a0-40d0-9423-4a9366439ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:11.729706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 679/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:12.044467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b333dc-68ef-4af4-bd0d-6f42c9b27f8e None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:12.045339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b333dc-68ef-4af4-bd0d-6f42c9b27f8e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:12.045826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b333dc-68ef-4af4-bd0d-6f42c9b27f8e None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:12.047408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 695/1374] 10.222.0.13 () {54 vars in 963 bytes} [Fri Jun 24 14:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:12.053364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae241fc-76cd-42b0-b86e-bda2975c5bf4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:12.053364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae241fc-76cd-42b0-b86e-bda2975c5bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:12.053364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae241fc-76cd-42b0-b86e-bda2975c5bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:12.060776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:21:12.108671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0ae241fc-76cd-42b0-b86e-bda2975c5bf4 None None] MFA Rules not processed for user `60d9764e77334bfba5bf18cdb026bd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:12.109875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0ae241fc-76cd-42b0-b86e-bda2975c5bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:12.179237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 680/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Fri Jun 24 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:12.181095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b333dc-68ef-4af4-bd0d-6f42c9b27f8e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:12.196815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b333dc-68ef-4af4-bd0d-6f42c9b27f8e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:12.201143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:12.201918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:12.202382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:12.203228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:12.220966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:12.222709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd794e0c-a188-4a0b-bf65-540047a6c1a0 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:12.236738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 696/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:13.171762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b784e-c841-47b2-aadf-d97b2789beb6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:13.172346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b784e-c841-47b2-aadf-d97b2789beb6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:13.172723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b784e-c841-47b2-aadf-d97b2789beb6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:13.174376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 681/1377] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:13.179578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bf37-1118-4e2a-9c0c-64b790d83bd0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:13.180052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bf37-1118-4e2a-9c0c-64b790d83bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:13.180217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bf37-1118-4e2a-9c0c-64b790d83bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:13.197962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-76b6bf37-1118-4e2a-9c0c-64b790d83bd0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:13.199158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-76b6bf37-1118-4e2a-9c0c-64b790d83bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:13.206867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 697/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:13.251250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b784e-c841-47b2-aadf-d97b2789beb6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:13.265918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b784e-c841-47b2-aadf-d97b2789beb6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:13.271568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:13.272231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:13.272516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:13.272794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:13.281861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:13.283479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ae8d-b134-4403-898c-b19ba1d20652 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:13.293734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 682/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:15.379154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11abd1-dd43-463d-ac0b-6f9a60b2e295 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:15.379642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11abd1-dd43-463d-ac0b-6f9a60b2e295 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:15.379642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11abd1-dd43-463d-ac0b-6f9a60b2e295 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:15.381080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 698/1380] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:15.386537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbd9-d10d-40a3-97a2-4ac9557f7a20 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:15.386948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbd9-d10d-40a3-97a2-4ac9557f7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:15.387090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abbd9-d10d-40a3-97a2-4ac9557f7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:15.405734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c15abbd9-d10d-40a3-97a2-4ac9557f7a20 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:15.406910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c15abbd9-d10d-40a3-97a2-4ac9557f7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:15.415375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 683/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:15.458345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11abd1-dd43-463d-ac0b-6f9a60b2e295 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:15.473889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11abd1-dd43-463d-ac0b-6f9a60b2e295 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:15.479928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:15.480592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:15.480872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:15.481146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:15.489373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:15.491003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482de4d-8747-4ae1-9f21-5cf726c71cf7 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:15.501077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 699/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:17.585097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233bf-2174-419f-933c-3f8f42b3566e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:17.586493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233bf-2174-419f-933c-3f8f42b3566e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:17.586772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233bf-2174-419f-933c-3f8f42b3566e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:17.588332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 684/1383] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:17.593482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed90-bb56-488f-a69e-ad2cb2ee4f45 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:17.593912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed90-bb56-488f-a69e-ad2cb2ee4f45 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:17.594034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed90-bb56-488f-a69e-ad2cb2ee4f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:17.612763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-30a4ed90-bb56-488f-a69e-ad2cb2ee4f45 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:17.613966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-30a4ed90-bb56-488f-a69e-ad2cb2ee4f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:17.624365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 700/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:21:17.663477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722233bf-2174-419f-933c-3f8f42b3566e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:17.678797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722233bf-2174-419f-933c-3f8f42b3566e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:17.684972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:17.685603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:17.685881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:17.686155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:17.694781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:17.696939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23acc64-234a-4c40-a54b-3513bae79685 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:17.707327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 685/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:19.774445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad488f87-2f42-49b0-b351-26fb3823b1cb None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:19.774923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad488f87-2f42-49b0-b351-26fb3823b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:19.774923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad488f87-2f42-49b0-b351-26fb3823b1cb None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:19.779702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 701/1386] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:19.781741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1b9-d408-41e0-a577-a52a7d8a7759 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:19.782358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1b9-d408-41e0-a577-a52a7d8a7759 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:19.782358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f1b9-d408-41e0-a577-a52a7d8a7759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:19.802522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-26e4f1b9-d408-41e0-a577-a52a7d8a7759 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:19.803711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-26e4f1b9-d408-41e0-a577-a52a7d8a7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:19.811534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 686/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:21:19.855967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad488f87-2f42-49b0-b351-26fb3823b1cb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:19.871280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad488f87-2f42-49b0-b351-26fb3823b1cb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:19.876807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:19.877452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:19.877734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:19.878010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:19.887212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:19.888860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96bf80-60e5-47a3-a240-0ba7eaa029bd service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:19.898505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 702/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:22.389789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc734a-9572-40fd-9b9a-c83e1e86d56d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:22.390351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc734a-9572-40fd-9b9a-c83e1e86d56d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:22.390351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc734a-9572-40fd-9b9a-c83e1e86d56d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:22.391722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 687/1389] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:22.397271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a5163-389a-4ef0-bd92-992815abef42 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:22.397716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a5163-389a-4ef0-bd92-992815abef42 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:22.397907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a5163-389a-4ef0-bd92-992815abef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:22.416177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-571a5163-389a-4ef0-bd92-992815abef42 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:22.417378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-571a5163-389a-4ef0-bd92-992815abef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:22.425364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 703/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:22.469418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc734a-9572-40fd-9b9a-c83e1e86d56d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:22.488964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc734a-9572-40fd-9b9a-c83e1e86d56d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:22.497067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:22.497989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:22.498348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:22.498724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:22.511294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:22.512934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e0a4-bd06-40a9-bb45-69d27f62e850 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:22.531166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 688/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:24.645178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1eb7-2567-4deb-b6d3-28488ff80f0b None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:24.645919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1eb7-2567-4deb-b6d3-28488ff80f0b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:24.645919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1eb7-2567-4deb-b6d3-28488ff80f0b None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:24.647112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 704/1392] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:21:24.655232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5852b-f3ea-403d-a6fe-051df3b1d333 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:24.655729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5852b-f3ea-403d-a6fe-051df3b1d333 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:24.655915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5852b-f3ea-403d-a6fe-051df3b1d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:24.674121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f6d5852b-f3ea-403d-a6fe-051df3b1d333 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:24.675353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6d5852b-f3ea-403d-a6fe-051df3b1d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:24.683265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 689/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:24.727912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af1eb7-2567-4deb-b6d3-28488ff80f0b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:24.743804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af1eb7-2567-4deb-b6d3-28488ff80f0b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:24.749324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:24.749964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:24.750249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:24.750524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:24.759576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:24.761204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c1b2-f154-4bf6-97ac-da59da175d26 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:24.770835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 705/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:26.861221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75ee6-f3dd-4baf-a7ec-b75847f479cd None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:26.861767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75ee6-f3dd-4baf-a7ec-b75847f479cd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:26.861767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75ee6-f3dd-4baf-a7ec-b75847f479cd None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:26.863138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 690/1395] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:26.868390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19ab9c-6ab9-43e3-b046-b60c7e83142f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:26.868822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19ab9c-6ab9-43e3-b046-b60c7e83142f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:26.868947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19ab9c-6ab9-43e3-b046-b60c7e83142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:26.886695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5e19ab9c-6ab9-43e3-b046-b60c7e83142f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:26.887874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5e19ab9c-6ab9-43e3-b046-b60c7e83142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:26.895619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 706/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:26.940401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75ee6-f3dd-4baf-a7ec-b75847f479cd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:26.955012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75ee6-f3dd-4baf-a7ec-b75847f479cd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:26.960303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:26.961512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:26.961787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:26.962083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:26.970107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:26.971681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ea6ef-725d-45ad-8bfd-dea84c586bec service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:26.981416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 691/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:27.669994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b4e-a6e7-48c3-a998-ba6ac4945db7 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:27.670286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b4e-a6e7-48c3-a998-ba6ac4945db7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:27.670566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a9b4e-a6e7-48c3-a998-ba6ac4945db7 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:27.671957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 707/1398] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:27.677327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b6d-3ccc-4f73-a104-eda8f6c8fd52 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:27.677612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b6d-3ccc-4f73-a104-eda8f6c8fd52 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:27.677886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124b6d-3ccc-4f73-a104-eda8f6c8fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:27.696326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bd124b6d-3ccc-4f73-a104-eda8f6c8fd52 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:27.697581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bd124b6d-3ccc-4f73-a104-eda8f6c8fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:27.705972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 692/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:27.763222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f6e0-cc2b-4917-acc4-aa36ceaad812 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:27.763510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f6e0-cc2b-4917-acc4-aa36ceaad812 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:27.763808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f6e0-cc2b-4917-acc4-aa36ceaad812 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:27.765281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 708/1400] 10.222.0.13 () {54 vars in 962 bytes} [Fri Jun 24 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:27.770306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63f87-ca46-492b-a7d1-3c33fdbef6ef None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:27.770682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63f87-ca46-492b-a7d1-3c33fdbef6ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:27.770961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d63f87-ca46-492b-a7d1-3c33fdbef6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:27.819179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-73d63f87-ca46-492b-a7d1-3c33fdbef6ef None None] MFA Rules not processed for user `4d3b4e1e918440858a0f10b8eadb4f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:27.821182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73d63f87-ca46-492b-a7d1-3c33fdbef6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:27.853723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:21:27.882405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 693/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Fri Jun 24 14:21:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:27.889686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498f6e0-cc2b-4917-acc4-aa36ceaad812 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:27.900847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498f6e0-cc2b-4917-acc4-aa36ceaad812 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:27.904391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:27.905017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:27.905294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:27.905565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:27.915068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:27.916531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c235-6f83-41e2-86f8-d63539828bc9 service glance] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:27.925926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 709/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:28.640192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230476-22d3-47bd-8e2a-7a23bab74c25 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:28.640486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230476-22d3-47bd-8e2a-7a23bab74c25 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:28.640767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230476-22d3-47bd-8e2a-7a23bab74c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:28.689109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ed230476-22d3-47bd-8e2a-7a23bab74c25 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:28.690303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ed230476-22d3-47bd-8e2a-7a23bab74c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:28.755056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 694/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:21:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:28.796792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c329d8-5d19-4bc0-8b06-f727ebfdb9ce None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:28.797104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c329d8-5d19-4bc0-8b06-f727ebfdb9ce None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:28.797380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c329d8-5d19-4bc0-8b06-f727ebfdb9ce None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:28.798795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 710/1404] 10.222.0.13 () {54 vars in 942 bytes} [Fri Jun 24 14:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:28.805876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222256-2033-461c-9456-e89d91c0e461 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:28.806240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222256-2033-461c-9456-e89d91c0e461 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:28.806590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222256-2033-461c-9456-e89d91c0e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:28.857378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-75222256-2033-461c-9456-e89d91c0e461 None None] MFA Rules not processed for user `b8263daa298542be9a90840f5417e1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:28.858491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-75222256-2033-461c-9456-e89d91c0e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:28.928557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 695/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Fri Jun 24 14:21:28 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:28.937857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c329d8-5d19-4bc0-8b06-f727ebfdb9ce None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:28.945273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=61 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:21:28.953235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c329d8-5d19-4bc0-8b06-f727ebfdb9ce None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:28.959429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:28.960176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:28.961071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:28.961411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:28.970745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:28.972730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422ad4-ad37-4192-91af-d7b76e255b92 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:28.981866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 711/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:21:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:21:29.077774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc138a-7af7-43ca-b5f1-fc93506b6898 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:29.078178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc138a-7af7-43ca-b5f1-fc93506b6898 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:29.078458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc138a-7af7-43ca-b5f1-fc93506b6898 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:29.079724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 696/1407] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:29.086681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb842-d5d2-47db-a756-fde1f60ea840 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:29.086681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb842-d5d2-47db-a756-fde1f60ea840 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:29.086681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb842-d5d2-47db-a756-fde1f60ea840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:29.105174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-41acb842-d5d2-47db-a756-fde1f60ea840 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:29.106743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-41acb842-d5d2-47db-a756-fde1f60ea840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:29.124571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 712/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:29.162108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc138a-7af7-43ca-b5f1-fc93506b6898 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:29.178835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc138a-7af7-43ca-b5f1-fc93506b6898 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:29.185111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:29.185744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:29.186025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:29.186302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:29.195567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:29.197242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8e89-40f1-4158-939d-46fb0daffa22 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:29.202276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:21:29.209664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 697/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:39.099774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=8 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:21:51.283726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493491-45f7-4ddb-b7c0-97cea04d9b06 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:51.284402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493491-45f7-4ddb-b7c0-97cea04d9b06 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:51.284402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493491-45f7-4ddb-b7c0-97cea04d9b06 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:51.285726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 713/1410] 10.222.0.13 () {54 vars in 918 bytes} [Fri Jun 24 14:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:51.291594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b3b7-a04a-4372-8c26-d1530aa4fce4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:51.292008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b3b7-a04a-4372-8c26-d1530aa4fce4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:51.292191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b3b7-a04a-4372-8c26-d1530aa4fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:51.310715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c631b3b7-a04a-4372-8c26-d1530aa4fce4 None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:51.311927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c631b3b7-a04a-4372-8c26-d1530aa4fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:51.320343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 698/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jun 24 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:51.334387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cf03-11db-4889-9bda-aa01586644a5 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:51.334703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cf03-11db-4889-9bda-aa01586644a5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:51.334981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cf03-11db-4889-9bda-aa01586644a5 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:51.336905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 714/1412] 10.222.0.13 () {54 vars in 918 bytes} [Fri Jun 24 14:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:51.341408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a3e76-44da-4445-88b4-c053d49537d4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:51.341725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a3e76-44da-4445-88b4-c053d49537d4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:51.342000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a3e76-44da-4445-88b4-c053d49537d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:51.360223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-723a3e76-44da-4445-88b4-c053d49537d4 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:51.361401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-723a3e76-44da-4445-88b4-c053d49537d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:51.370349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 699/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jun 24 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:21:54.384163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991793fe-e2a8-463a-ba48-72b31f601d88 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:54.384722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991793fe-e2a8-463a-ba48-72b31f601d88 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:54.384722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991793fe-e2a8-463a-ba48-72b31f601d88 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:54.386067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:54.391305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbafb54-c753-42dc-bc3d-1dabb7f6e257 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:54.391728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbafb54-c753-42dc-bc3d-1dabb7f6e257 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:54.391864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbafb54-c753-42dc-bc3d-1dabb7f6e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:54.409767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-acbafb54-c753-42dc-bc3d-1dabb7f6e257 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:54.410991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-acbafb54-c753-42dc-bc3d-1dabb7f6e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:54.419615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:54.463857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991793fe-e2a8-463a-ba48-72b31f601d88 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:54.482271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991793fe-e2a8-463a-ba48-72b31f601d88 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:54.489474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:54.490375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:54.490782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:54.491181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:54.502617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:54.505121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476252-cf26-449b-80c7-a9c93e24560f service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:54.518013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 716/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:55.430338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b920e1-d8be-4224-851c-78ef95ce2c44 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:55.430900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b920e1-d8be-4224-851c-78ef95ce2c44 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:55.430900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b920e1-d8be-4224-851c-78ef95ce2c44 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:55.432293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:55.437104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b95e2-49d9-4950-a4a8-c29fd42ab98b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:55.437542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b95e2-49d9-4950-a4a8-c29fd42ab98b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:55.437681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b95e2-49d9-4950-a4a8-c29fd42ab98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:55.456474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3a9b95e2-49d9-4950-a4a8-c29fd42ab98b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:55.457655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3a9b95e2-49d9-4950-a4a8-c29fd42ab98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:55.465817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:55.617278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b920e1-d8be-4224-851c-78ef95ce2c44 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:55.631274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b920e1-d8be-4224-851c-78ef95ce2c44 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:55.636757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:55.637377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:55.637656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:55.637927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:55.646051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:55.647876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46797bf-da00-4308-ae91-c388d7ec89cf service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:55.657472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 702/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:56.549979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e52c-1f4e-41f2-8b1d-eb5d5ac3e1f7 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:56.550533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e52c-1f4e-41f2-8b1d-eb5d5ac3e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:56.550533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e52c-1f4e-41f2-8b1d-eb5d5ac3e1f7 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:56.551922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:56.557043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5aa0-edcc-4884-8f03-646705d85584 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:56.557441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5aa0-edcc-4884-8f03-646705d85584 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:56.557601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b5aa0-edcc-4884-8f03-646705d85584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:56.575333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d27b5aa0-edcc-4884-8f03-646705d85584 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:56.576588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d27b5aa0-edcc-4884-8f03-646705d85584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:56.584758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:56.739320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e52c-1f4e-41f2-8b1d-eb5d5ac3e1f7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:56.753498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e52c-1f4e-41f2-8b1d-eb5d5ac3e1f7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:56.758951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:56.759571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:56.759852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:56.760161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:56.768159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:56.769753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b6e1a-4c50-40f7-ae55-9033dc3e2647 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:56.779577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 719/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:57.659523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3cd0-b2c1-4662-a6c8-77a30842aec2 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:57.660139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3cd0-b2c1-4662-a6c8-77a30842aec2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:57.660139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3cd0-b2c1-4662-a6c8-77a30842aec2 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:57.661472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:57.666460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064fbb-b584-44b3-9078-3860e747889c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:57.666888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064fbb-b584-44b3-9078-3860e747889c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:57.667016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064fbb-b584-44b3-9078-3860e747889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:57.685112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7e064fbb-b584-44b3-9078-3860e747889c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:57.686396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7e064fbb-b584-44b3-9078-3860e747889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:57.694313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:57.852390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3cd0-b2c1-4662-a6c8-77a30842aec2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:57.871875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3cd0-b2c1-4662-a6c8-77a30842aec2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:57.877601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:57.878358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:57.878639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:57.878915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:57.888126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:57.889714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64473b2f-b28b-4629-98f4-0355700a338c service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:57.900257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 705/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:58.778017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbb0f-11e2-4bda-b4dd-f32bc013d741 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:58.778590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbb0f-11e2-4bda-b4dd-f32bc013d741 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:58.778590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbb0f-11e2-4bda-b4dd-f32bc013d741 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:58.779989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:58.784803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b22a2-121e-486e-b825-b5c2bb2616f3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:58.785189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b22a2-121e-486e-b825-b5c2bb2616f3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:58.785359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b22a2-121e-486e-b825-b5c2bb2616f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:58.803512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-465b22a2-121e-486e-b825-b5c2bb2616f3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:58.804789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-465b22a2-121e-486e-b825-b5c2bb2616f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:58.812606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:21:58.971750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cbb0f-11e2-4bda-b4dd-f32bc013d741 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:21:58.986986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cbb0f-11e2-4bda-b4dd-f32bc013d741 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:21:58.992872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:21:58.993487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:58.993763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:58.994027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:59.001970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:21:59.003543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de56be-efdd-4410-9c9f-13816234c936 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:21:59.013283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 722/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:21:59.821290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0e41-fbb4-46b7-b7fe-2d58c4a78238 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:59.821863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0e41-fbb4-46b7-b7fe-2d58c4a78238 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:59.821863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0e41-fbb4-46b7-b7fe-2d58c4a78238 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:59.823209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:21:59.828177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2dbd6-b911-446d-943e-e64dad4609a6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:21:59.828619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2dbd6-b911-446d-943e-e64dad4609a6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:21:59.828730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2dbd6-b911-446d-943e-e64dad4609a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:21:59.847686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-78d2dbd6-b911-446d-943e-e64dad4609a6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:21:59.848900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-78d2dbd6-b911-446d-943e-e64dad4609a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:21:59.857619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:22:00.007266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf0e41-fbb4-46b7-b7fe-2d58c4a78238 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:00.021165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf0e41-fbb4-46b7-b7fe-2d58c4a78238 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:00.026472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:00.027091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:00.027368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:00.027637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:00.035812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:00.037444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4973784-4ab2-4eab-8fe4-4d81759547d0 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:00.047567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 708/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:00.844570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259e18-6fd8-4df0-abfd-788af20edaaa None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:00.845115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259e18-6fd8-4df0-abfd-788af20edaaa None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:00.845115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259e18-6fd8-4df0-abfd-788af20edaaa None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:00.846505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:00.852332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc4da-d500-4714-950b-e132f2425463 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:00.852751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc4da-d500-4714-950b-e132f2425463 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:00.852909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc4da-d500-4714-950b-e132f2425463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:00.870841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6fcfc4da-d500-4714-950b-e132f2425463 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:00.872012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6fcfc4da-d500-4714-950b-e132f2425463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:00.879682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:01.032393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44259e18-6fd8-4df0-abfd-788af20edaaa None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:01.048309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44259e18-6fd8-4df0-abfd-788af20edaaa None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:01.053676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:01.054814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:01.055099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:01.055373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:01.063415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:01.065035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4ba5b-500c-4eb9-abb4-9462f06fcd8a service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:01.074859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 725/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:01.883587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934696c8-08d0-425d-8ea7-ea8550e2d329 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:01.884187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934696c8-08d0-425d-8ea7-ea8550e2d329 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:01.884187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934696c8-08d0-425d-8ea7-ea8550e2d329 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:01.885542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:01.890706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd68f4-757e-4fc6-9c99-f593ca1b68ae None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:01.891110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd68f4-757e-4fc6-9c99-f593ca1b68ae None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:01.891290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd68f4-757e-4fc6-9c99-f593ca1b68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:01.909528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-25bd68f4-757e-4fc6-9c99-f593ca1b68ae None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:01.910695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-25bd68f4-757e-4fc6-9c99-f593ca1b68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:01.920991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:02.072216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934696c8-08d0-425d-8ea7-ea8550e2d329 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:02.087611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934696c8-08d0-425d-8ea7-ea8550e2d329 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:02.092952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:02.093678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:02.093938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:02.094213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:02.102997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:02.104625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacef53e-048d-4907-a9f9-a1f9af74171e service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:02.114060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 711/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:02.911514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53440657-c0ca-47f1-8eff-b8c36cf42b9a None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:02.912218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53440657-c0ca-47f1-8eff-b8c36cf42b9a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:02.912218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53440657-c0ca-47f1-8eff-b8c36cf42b9a None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:02.913976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:02.919165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9006-90c3-438a-903d-798d539ec197 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:02.919603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9006-90c3-438a-903d-798d539ec197 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:02.919727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9006-90c3-438a-903d-798d539ec197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:02.938275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-386f9006-90c3-438a-903d-798d539ec197 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:02.939485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-386f9006-90c3-438a-903d-798d539ec197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:02.947325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:03.099486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53440657-c0ca-47f1-8eff-b8c36cf42b9a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:03.114745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53440657-c0ca-47f1-8eff-b8c36cf42b9a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:03.120928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:03.121562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:03.121852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:03.122127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:03.130417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:03.132066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abde2e3-aa5b-426c-a1ec-7a3329b8678e service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:03.141323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 728/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:05.091749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ae71-bc28-407d-b128-636a85b16970 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:05.092382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ae71-bc28-407d-b128-636a85b16970 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:05.092382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ae71-bc28-407d-b128-636a85b16970 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:05.093705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:05.099110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcce3-9ee8-43dd-9c50-4c8464a2bfb8 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:05.099536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcce3-9ee8-43dd-9c50-4c8464a2bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:05.099692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcce3-9ee8-43dd-9c50-4c8464a2bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:05.118192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3a6bcce3-9ee8-43dd-9c50-4c8464a2bfb8 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:05.119382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3a6bcce3-9ee8-43dd-9c50-4c8464a2bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:05.127123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:05.165400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10ae71-bc28-407d-b128-636a85b16970 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:05.176234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10ae71-bc28-407d-b128-636a85b16970 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:05.180314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:05.180935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:05.181218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:05.181490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:05.190223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:05.191642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14d423-1e5b-4553-9339-36f01f2808a0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:05.200854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 714/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:07.428330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:07.428890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:07.429018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:07.430497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:07.436260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ad6c-6b46-403a-8caa-a76cad2a6362 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:07.436668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ad6c-6b46-403a-8caa-a76cad2a6362 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:07.436810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ad6c-6b46-403a-8caa-a76cad2a6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:07.454009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b0f3ad6c-6b46-403a-8caa-a76cad2a6362 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:07.455193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b0f3ad6c-6b46-403a-8caa-a76cad2a6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:07.462909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:07.501087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:07.502752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:07.515655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a46be-c64e-4e28-b6e1-04469f726c90 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:07.519685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:07.520343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:07.520623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:07.520892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:07.529562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:07.530982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb7538-4b6b-471e-aca2-d22cbe7d43f4 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:07.540645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 731/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:09.887975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5b4a-67eb-4df1-8184-119c22acb0a6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:09.888538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5b4a-67eb-4df1-8184-119c22acb0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:09.888538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5b4a-67eb-4df1-8184-119c22acb0a6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:09.889831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:09.895053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141a79-fe68-42d7-85ef-311b2a9aacf2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:09.895480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141a79-fe68-42d7-85ef-311b2a9aacf2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:09.895584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141a79-fe68-42d7-85ef-311b2a9aacf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:09.912723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e2141a79-fe68-42d7-85ef-311b2a9aacf2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:09.914439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e2141a79-fe68-42d7-85ef-311b2a9aacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:09.922069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:09.959847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5b4a-67eb-4df1-8184-119c22acb0a6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:09.971182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5b4a-67eb-4df1-8184-119c22acb0a6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:09.975024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:09.975646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:09.976575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:09.976860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:09.985690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:09.987115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c1497-7d96-4380-8c5d-e6c2629c7333 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:09.996984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 717/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:12.178309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5372-5fff-4cd9-a0f5-a1ce05acdb73 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:12.178790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5372-5fff-4cd9-a0f5-a1ce05acdb73 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:12.178952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5372-5fff-4cd9-a0f5-a1ce05acdb73 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:12.180835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:12.186348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3584625-e47d-4943-8ca1-3157036ee104 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:12.186833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3584625-e47d-4943-8ca1-3157036ee104 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:12.186947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3584625-e47d-4943-8ca1-3157036ee104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:12.205136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e3584625-e47d-4943-8ca1-3157036ee104 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:12.206318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e3584625-e47d-4943-8ca1-3157036ee104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:12.218576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:12.258645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf5372-5fff-4cd9-a0f5-a1ce05acdb73 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:12.269074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf5372-5fff-4cd9-a0f5-a1ce05acdb73 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:12.273127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:12.273754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:12.274031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:12.274300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:12.283666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:12.285416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c17d7-f5e4-4dc7-a48e-d35a2e114223 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:12.296394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 734/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:14.378886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05c17-061d-46f7-906e-3dda43718c1d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:14.379460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05c17-061d-46f7-906e-3dda43718c1d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:14.379460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05c17-061d-46f7-906e-3dda43718c1d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:14.380837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:14.386436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f7ff-dfcd-4178-8042-3b0a78fecf11 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:14.386842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f7ff-dfcd-4178-8042-3b0a78fecf11 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:14.386999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f7ff-dfcd-4178-8042-3b0a78fecf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:14.404960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9e47f7ff-dfcd-4178-8042-3b0a78fecf11 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:14.406130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9e47f7ff-dfcd-4178-8042-3b0a78fecf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:14.413783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:14.451346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05c17-061d-46f7-906e-3dda43718c1d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:14.463139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05c17-061d-46f7-906e-3dda43718c1d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:14.466600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:14.467231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:14.467514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:14.467790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:14.478120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:14.479555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702facc-5c43-4e5d-8c98-fe78384c2d97 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:14.488913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 720/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:22:16.619847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e9aa0-6b33-49fa-adee-40cd94984028 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:16.620457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e9aa0-6b33-49fa-adee-40cd94984028 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:16.620457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e9aa0-6b33-49fa-adee-40cd94984028 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:16.621806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:16.626973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a6eb-ef15-483d-9e72-c751b79f7110 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:16.627394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a6eb-ef15-483d-9e72-c751b79f7110 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:16.627527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a6eb-ef15-483d-9e72-c751b79f7110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:16.645295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-69d4a6eb-ef15-483d-9e72-c751b79f7110 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:16.646465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-69d4a6eb-ef15-483d-9e72-c751b79f7110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:16.654140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:16.691864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e9aa0-6b33-49fa-adee-40cd94984028 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:16.702608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e9aa0-6b33-49fa-adee-40cd94984028 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:16.706203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:16.706830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:16.707113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:16.707390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:16.716792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:16.718229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155957-4e5d-4e81-8508-d33f78fbffb5 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:16.728345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 737/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:18.809965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4752-4c66-4374-b94f-0479e3dedebe None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:18.810650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4752-4c66-4374-b94f-0479e3dedebe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:18.810650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4752-4c66-4374-b94f-0479e3dedebe None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:18.812542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:18.818150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488143f-76b1-4f18-a705-a46c64b72933 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:18.818602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488143f-76b1-4f18-a705-a46c64b72933 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:18.818725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488143f-76b1-4f18-a705-a46c64b72933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:18.836605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f488143f-76b1-4f18-a705-a46c64b72933 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:18.837790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f488143f-76b1-4f18-a705-a46c64b72933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:18.845501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:18.883821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f4752-4c66-4374-b94f-0479e3dedebe None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:18.894587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f4752-4c66-4374-b94f-0479e3dedebe None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:18.898136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:18.898754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:18.899028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:18.899297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:18.908166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:18.909595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61a0ae-9f6d-449d-811e-6c01c2c94254 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:18.919300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 723/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:20.978535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ccb1c-2131-41ec-acd0-55450a5b2288 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:20.979106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ccb1c-2131-41ec-acd0-55450a5b2288 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:20.979106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ccb1c-2131-41ec-acd0-55450a5b2288 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:20.980508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:20.985696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1dad1-d9b5-4533-826a-50eb9915d5b4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:20.986142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1dad1-d9b5-4533-826a-50eb9915d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:20.986260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1dad1-d9b5-4533-826a-50eb9915d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:20.992898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=79 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:22:21.005227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-63d1dad1-d9b5-4533-826a-50eb9915d5b4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:21.006408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-63d1dad1-d9b5-4533-826a-50eb9915d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:21.014143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:21.051321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ccb1c-2131-41ec-acd0-55450a5b2288 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:21.057326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=73 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:22:21.063666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ccb1c-2131-41ec-acd0-55450a5b2288 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:21.067197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:21.067821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:21.068139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:21.068414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:21.077285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:21.078727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dfee9-4373-4405-b4e5-f81967fdd179 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:21.087975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 740/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:23.166087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13617a9-1da9-48fb-8df6-8a1c82e0b1fc None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:23.166634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13617a9-1da9-48fb-8df6-8a1c82e0b1fc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:23.166808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13617a9-1da9-48fb-8df6-8a1c82e0b1fc None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:23.168067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:22:23.174224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41e96-38e7-48b0-b8cd-de09f618fe34 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:23.174808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41e96-38e7-48b0-b8cd-de09f618fe34 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:23.174808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e41e96-38e7-48b0-b8cd-de09f618fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:23.193664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-96e41e96-38e7-48b0-b8cd-de09f618fe34 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:23.194869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-96e41e96-38e7-48b0-b8cd-de09f618fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:23.202735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:23.239499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13617a9-1da9-48fb-8df6-8a1c82e0b1fc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:23.252343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13617a9-1da9-48fb-8df6-8a1c82e0b1fc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:23.255804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:23.256455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:23.256731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:23.257003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:23.266169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:23.267596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308ca7b-39c3-43a4-a7a3-6f16f5dcafc0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:23.277766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 726/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:25.337796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140092-fb40-44fe-829b-9e221dc06df4 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:25.338318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140092-fb40-44fe-829b-9e221dc06df4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:25.338318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140092-fb40-44fe-829b-9e221dc06df4 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:25.339711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:25.345026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc701ac-01a8-46f8-9ac8-15d79242c745 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:25.345462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc701ac-01a8-46f8-9ac8-15d79242c745 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:25.345568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc701ac-01a8-46f8-9ac8-15d79242c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:25.363749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fbc701ac-01a8-46f8-9ac8-15d79242c745 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:25.364965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fbc701ac-01a8-46f8-9ac8-15d79242c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:25.373361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:25.410384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140092-fb40-44fe-829b-9e221dc06df4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:25.420956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140092-fb40-44fe-829b-9e221dc06df4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:25.424447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:25.425074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:25.425357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:25.425629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:25.434306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:25.435745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea437c-027a-4db9-8793-36986dec7845 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:25.445538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 743/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:35.358576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=11 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:22:35.440883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=14 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:22:45.359493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d508cb-b870-4ba1-811f-51d8813deee6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:45.360122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d508cb-b870-4ba1-811f-51d8813deee6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:45.360122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d508cb-b870-4ba1-811f-51d8813deee6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:45.361514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 728/1471] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:45.367513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce735-818d-484b-9982-273d2d4c4936 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:45.367990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce735-818d-484b-9982-273d2d4c4936 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:45.368125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce735-818d-484b-9982-273d2d4c4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:45.385951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-66cce735-818d-484b-9982-273d2d4c4936 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:45.387186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-66cce735-818d-484b-9982-273d2d4c4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:45.394883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 744/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:45.441488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f866f-c601-4e34-bcf0-d3d373993198 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:45.441770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f866f-c601-4e34-bcf0-d3d373993198 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:45.442044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f866f-c601-4e34-bcf0-d3d373993198 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:45.443404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 729/1473] 10.222.0.13 () {54 vars in 962 bytes} [Fri Jun 24 14:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:45.448935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2e54-7e19-41f3-89b6-eb2168733d3d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:45.449219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2e54-7e19-41f3-89b6-eb2168733d3d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:45.449494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2e54-7e19-41f3-89b6-eb2168733d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:45.466918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1b1c2e54-7e19-41f3-89b6-eb2168733d3d None None] MFA Rules not processed for user `4d3b4e1e918440858a0f10b8eadb4f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:45.468103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1b1c2e54-7e19-41f3-89b6-eb2168733d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:45.474667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 745/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Fri Jun 24 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:45.481624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f866f-c601-4e34-bcf0-d3d373993198 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:45.492754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f866f-c601-4e34-bcf0-d3d373993198 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:45.496242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:45.496846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:45.497124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:45.497396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:45.506070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:45.508123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232238fe-bc2d-48c2-bbdf-95c9d859cbd2 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:45.517241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 730/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:47.617753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970577-0ea3-442f-a87e-dd63db4f9d83 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:47.618331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970577-0ea3-442f-a87e-dd63db4f9d83 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:47.618331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970577-0ea3-442f-a87e-dd63db4f9d83 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:47.619689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 746/1476] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:47.625016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a172a-520e-4497-a822-13f9d9942ff2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:47.625424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a172a-520e-4497-a822-13f9d9942ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:47.625566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a172a-520e-4497-a822-13f9d9942ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:47.644327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4b7a172a-520e-4497-a822-13f9d9942ff2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:47.645523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4b7a172a-520e-4497-a822-13f9d9942ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:47.654176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 731/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:47.677341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970577-0ea3-442f-a87e-dd63db4f9d83 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:47.691695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970577-0ea3-442f-a87e-dd63db4f9d83 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:47.698209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:47.698853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:47.699136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:47.699413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:47.700180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:47.701984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:22:47.701984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:22:47.701984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:22:47.703144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dbeab-1def-41e8-9dee-af4d586f2b68 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:47.727519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 747/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Jun 24 14:22:47 2022] GET /identity/v3/projects => generated 2553 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:22:49.778108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29242d5b-ef3c-4b38-ae8e-eeb2c4af1196 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:49.778670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29242d5b-ef3c-4b38-ae8e-eeb2c4af1196 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:49.778670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29242d5b-ef3c-4b38-ae8e-eeb2c4af1196 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:49.780067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 732/1479] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:49.785195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64775bd-67d4-4254-bcf3-a3437b989c33 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:49.785637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64775bd-67d4-4254-bcf3-a3437b989c33 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:49.785794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64775bd-67d4-4254-bcf3-a3437b989c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:49.804602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a64775bd-67d4-4254-bcf3-a3437b989c33 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:49.805810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a64775bd-67d4-4254-bcf3-a3437b989c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:49.813676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 748/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:49.856158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29242d5b-ef3c-4b38-ae8e-eeb2c4af1196 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:49.871219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29242d5b-ef3c-4b38-ae8e-eeb2c4af1196 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:49.876572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:49.877194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:49.877473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:49.877747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:49.886391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:49.887969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95808f01-e147-4c3b-b774-f135f27dec7a service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:49.897272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 733/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:52.096712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ad5c-93fc-44e9-a3d6-c10d8c1c2f64 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:52.097273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ad5c-93fc-44e9-a3d6-c10d8c1c2f64 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:52.097273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ad5c-93fc-44e9-a3d6-c10d8c1c2f64 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:52.098615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 749/1482] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:52.104889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23fd-333e-4b03-a58e-d40f35270b48 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:52.105671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23fd-333e-4b03-a58e-d40f35270b48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:52.105947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c23fd-333e-4b03-a58e-d40f35270b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:52.123249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b44c23fd-333e-4b03-a58e-d40f35270b48 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:52.124484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b44c23fd-333e-4b03-a58e-d40f35270b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:52.132444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 734/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:52.168578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988ad5c-93fc-44e9-a3d6-c10d8c1c2f64 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:52.179846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988ad5c-93fc-44e9-a3d6-c10d8c1c2f64 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:52.183392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:52.184067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:52.184524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:52.184826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:52.194940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:52.196445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9542260-9fc5-4d73-bf90-dbdb118e6a91 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:52.206810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 750/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:54.272208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd98be-daf7-470a-a811-fbcbda1a5cac None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:54.273310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd98be-daf7-470a-a811-fbcbda1a5cac None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:54.273310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd98be-daf7-470a-a811-fbcbda1a5cac None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:54.274624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 735/1485] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:54.279729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fac2-0333-48d3-81ed-10bb99271ccb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:54.280206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fac2-0333-48d3-81ed-10bb99271ccb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:54.280309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fac2-0333-48d3-81ed-10bb99271ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:54.298681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a7d8fac2-0333-48d3-81ed-10bb99271ccb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:54.299917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a7d8fac2-0333-48d3-81ed-10bb99271ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:54.307630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 751/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:22:54.345304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd98be-daf7-470a-a811-fbcbda1a5cac None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:54.356738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd98be-daf7-470a-a811-fbcbda1a5cac None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:54.360325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:54.360947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:54.361222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:54.361490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:54.370230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:54.371652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb848b-b711-4b7f-9bec-72388c69e185 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:54.381258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 736/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:56.523434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776e504-9af7-4338-8985-34dca10ec99b None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:56.523966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776e504-9af7-4338-8985-34dca10ec99b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:56.523966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776e504-9af7-4338-8985-34dca10ec99b None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:56.525337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 752/1488] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:56.530527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32bb6-c16b-4bb8-a72e-85ec29fb6dee None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:56.530965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32bb6-c16b-4bb8-a72e-85ec29fb6dee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:56.531068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32bb6-c16b-4bb8-a72e-85ec29fb6dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:56.548541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-13d32bb6-c16b-4bb8-a72e-85ec29fb6dee None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:56.549723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-13d32bb6-c16b-4bb8-a72e-85ec29fb6dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:56.557459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 737/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:56.597490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776e504-9af7-4338-8985-34dca10ec99b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:56.608407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776e504-9af7-4338-8985-34dca10ec99b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:56.611967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:56.612619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:56.612903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:56.613179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:56.621927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:56.623360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d088eb-1741-4ecf-8798-2006e6feaf32 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:56.633195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 753/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:22:58.833403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c30e7-dda1-488a-8471-c3b3553eb775 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:58.833949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c30e7-dda1-488a-8471-c3b3553eb775 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:58.833949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c30e7-dda1-488a-8471-c3b3553eb775 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:58.835981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 738/1491] 10.222.0.13 () {54 vars in 926 bytes} [Fri Jun 24 14:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:22:58.841099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bea11-992a-4dbf-b8bd-140ee650371e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:58.841528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bea11-992a-4dbf-b8bd-140ee650371e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:58.841639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bea11-992a-4dbf-b8bd-140ee650371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:58.859144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-136bea11-992a-4dbf-b8bd-140ee650371e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:22:58.860476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-136bea11-992a-4dbf-b8bd-140ee650371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:22:58.868171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 754/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Fri Jun 24 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:22:58.907331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c30e7-dda1-488a-8471-c3b3553eb775 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:22:58.917866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c30e7-dda1-488a-8471-c3b3553eb775 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:22:58.921383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:22:58.922001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:22:58.922274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:22:58.922543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:22:58.931208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:22:58.932735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e2277-92d5-4faf-8752-5fd91f18d093 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:22:58.941863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 739/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:23:08.854145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=33 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:23:08.937855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=33 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:24:25.861064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:25.861665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:25.861665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:25.879712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:24:25.880935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:25.888773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 755/1494] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:24:25.897793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:25.898286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:25.898389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:25.916273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:24:25.917453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:25.925180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 740/1495] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:24:25.930036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:25.939492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f749-64de-4f8a-94ee-b4070daded96 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:25.943945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:25.945153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:25.945437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:25.945714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:25.946429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:24:25.946740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:25.947746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:25.947746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:24:25.947746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:24:25.948678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:25.959891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 756/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:24:25.968152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:25.978043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf22cb-9bed-492c-8fbd-6dc5f5fe12a0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:25.986494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:25.987143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:25.987424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:25.987700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:25.988435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:25.990208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:25.990208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:24:25.990208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:24:25.992195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.026959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 741/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:24:25 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:24:26.031330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.041752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3babd-3db4-4f27-86c5-86f136da92c4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.097544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.098192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.098468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.098739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.099417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.100513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:26.100513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:24:26.100513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:24:26.102683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.121882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 757/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:24:26 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:24:26.126091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.136694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165d73-1b72-4720-b114-7c85bb4f6cbe admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.141157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.141801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.142077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.142344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.143058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.144088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:26.144088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:24:26.144088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:24:26.144965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.157952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 742/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:24:26.162252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.172653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1038-2723-476c-8996-9b409a9a469d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.177137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.177783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.178065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.178436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.179163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.180223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:26.180223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:24:26.180223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:24:26.181094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796919d8-6c09-4bab-9291-28c0d5ccb084 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.194067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 758/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:24:26.198018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.207625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff70ba5-df57-495a-a490-c24b53ccf00e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.212642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.213934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.214217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.214489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] PATH_INFO: `/v3/projects/609dd67027e04b50bb8af62bd11b643d/users/77628df4f86a49a39a918d185ec5fdd0/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.230394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=609dd67027e04b50bb8af62bd11b643d, user_id=77628df4f86a49a39a918d185ec5fdd0, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.231423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:26.231423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:24:26.231423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:24:26.233406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc5d17-02a2-497c-a398-73c2c0207b9f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.245718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 743/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:24:26 2022] PUT /identity/v3/projects/609dd67027e04b50bb8af62bd11b643d/users/77628df4f86a49a39a918d185ec5fdd0/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:24:26.256665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bc27-d37d-434b-b83b-4700abeb7002 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.256983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bc27-d37d-434b-b83b-4700abeb7002 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.257276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bc27-d37d-434b-b83b-4700abeb7002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.283056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a4f8bc27-d37d-434b-b83b-4700abeb7002 None None] MFA Rules not processed for user `77628df4f86a49a39a918d185ec5fdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:24:26.284270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a4f8bc27-d37d-434b-b83b-4700abeb7002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:26.346377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 759/1502] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:24:26.360444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2489f6-65ad-4ca5-904c-6954143e18e8 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.360738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2489f6-65ad-4ca5-904c-6954143e18e8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.361049 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2489f6-65ad-4ca5-904c-6954143e18e8 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.362508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 744/1503] 10.222.0.13 () {54 vars in 963 bytes} [Fri Jun 24 14:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:24:26.367957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef653d-3323-435b-90e4-17b45d0dc338 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.368278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef653d-3323-435b-90e4-17b45d0dc338 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.368581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef653d-3323-435b-90e4-17b45d0dc338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.386591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-87ef653d-3323-435b-90e4-17b45d0dc338 None None] MFA Rules not processed for user `60d9764e77334bfba5bf18cdb026bd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:24:26.387726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-87ef653d-3323-435b-90e4-17b45d0dc338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:26.429395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:24:26.437901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 760/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Fri Jun 24 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:24:26.445759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2489f6-65ad-4ca5-904c-6954143e18e8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.456149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2489f6-65ad-4ca5-904c-6954143e18e8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.459593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.460244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.460531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.460811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.468872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.470297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.479703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 745/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:24:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:24:26.524407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465f5b-9ba4-44a8-838f-69ed628e4845 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.524697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465f5b-9ba4-44a8-838f-69ed628e4845 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.524976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465f5b-9ba4-44a8-838f-69ed628e4845 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.526280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 761/1506] 10.222.0.13 () {52 vars in 829 bytes} [Fri Jun 24 14:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:24:26.530053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.591658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db332-8937-41fc-9e0a-100fea440a36 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.596120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.596973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.597254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.597532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] PATH_INFO: `/v3/users/77628df4f86a49a39a918d185ec5fdd0` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.598708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77628df4f86a49a39a918d185ec5fdd0)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.599721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:26.599721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:24:26.599721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:24:26.601773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.666232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77628df4f86a49a39a918d185ec5fdd0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:26.678155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77628df4f86a49a39a918d185ec5fdd0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:26.679472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77628df4f86a49a39a918d185ec5fdd0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:26.680187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77628df4f86a49a39a918d185ec5fdd0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:26.689122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77628df4f86a49a39a918d185ec5fdd0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:26.705040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:24:26.716440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 746/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:24:26 2022] DELETE /identity/v3/users/77628df4f86a49a39a918d185ec5fdd0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:24:26.720859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.721156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.721437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.739366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:24:26.740603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:26.798115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 762/1508] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:24:26.808041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:26.809461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:26.867462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d352f-9fee-441c-850c-9bd08490f36f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:26.871147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:26.871783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:26.872091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:26.872360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:26.882854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:26.884531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41527e77-b5e6-432a-a23c-b6cfd66b31e8 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:26.894203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 747/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:24:27.215178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:24:27.216726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:24:27.230314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b78a9-92fd-4c84-a9f0-3abce8d5be14 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:24:27.235076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:24:27.235852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:24:27.236191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:24:27.236473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] PATH_INFO: `/v3/projects/609dd67027e04b50bb8af62bd11b643d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:24:27.237676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609dd67027e04b50bb8af62bd11b643d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:24:27.238705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:24:27.238705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:24:27.238705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:24:27.239922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:24:27.301909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609dd67027e04b50bb8af62bd11b643d', 'request_id': 'req-38531732-760b-4b1f-8ace-66ec5be5a346'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:27.308386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609dd67027e04b50bb8af62bd11b643d', 'request_id': 'req-38531732-760b-4b1f-8ace-66ec5be5a346'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:27.317708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609dd67027e04b50bb8af62bd11b643d', 'request_id': 'req-38531732-760b-4b1f-8ace-66ec5be5a346'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:27.335937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] The token cache is being invalidate because project 609dd67027e04b50bb8af62bd11b643d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:24:27.336254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:27.336898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-38531732-760b-4b1f-8ace-66ec5be5a346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:24:27.338572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 763/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:24:27 2022] DELETE /identity/v3/projects/609dd67027e04b50bb8af62bd11b643d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:24:36.890008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:24:37.332817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:26:13.844475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:13.845089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:13.845089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:13.846417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:13.851336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692a65-f8f6-4e35-b03e-afc0e97a7555 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:13.852066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692a65-f8f6-4e35-b03e-afc0e97a7555 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:13.852178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70692a65-f8f6-4e35-b03e-afc0e97a7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:13.871017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-70692a65-f8f6-4e35-b03e-afc0e97a7555 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:13.872279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-70692a65-f8f6-4e35-b03e-afc0e97a7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:13.934036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:26:14.087483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:14.089198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:14.161403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a66c1-a2fa-4f0e-8989-42fb0435b864 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:14.167284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:14.167916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:14.168226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:14.168511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:14.176530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:14.178110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34140dd6-ca73-428a-b48e-e71830b69aa4 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:14.187357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 749/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:15.036482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a62a8-2742-4d3e-b2d6-1ca1f0ad7227 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:15.037062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a62a8-2742-4d3e-b2d6-1ca1f0ad7227 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:15.037062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a62a8-2742-4d3e-b2d6-1ca1f0ad7227 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:15.038525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:15.043536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673250-a752-42c7-a43a-80d30e6d9f17 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:15.043946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673250-a752-42c7-a43a-80d30e6d9f17 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:15.044137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad673250-a752-42c7-a43a-80d30e6d9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:15.062445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ad673250-a752-42c7-a43a-80d30e6d9f17 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:15.063627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad673250-a752-42c7-a43a-80d30e6d9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:15.071890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:26:15.222629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a62a8-2742-4d3e-b2d6-1ca1f0ad7227 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:15.237264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a62a8-2742-4d3e-b2d6-1ca1f0ad7227 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:15.242569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:15.243762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:15.244079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:15.244359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:15.252377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:15.254008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a0348-c61c-489c-8c0d-9befec983436 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:15.263825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 766/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:16.243968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b06bf-8bf6-4a19-8b22-8c71e67eb8a1 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:16.244459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b06bf-8bf6-4a19-8b22-8c71e67eb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:16.244557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b06bf-8bf6-4a19-8b22-8c71e67eb8a1 None None] PATH_INFO: `/v3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:16.245844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 751/1517] 10.222.0.59 () {54 vars in 925 bytes} [Fri Jun 24 14:26:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:26:16.253035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b451-208d-477b-84df-c95e7b934a63 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:16.253451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b451-208d-477b-84df-c95e7b934a63 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:16.253592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b451-208d-477b-84df-c95e7b934a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:16.271949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9a26b451-208d-477b-84df-c95e7b934a63 None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:16.273178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9a26b451-208d-477b-84df-c95e7b934a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:16.335175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 767/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 24 14:26:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:25.057194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=37 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:26:26.326749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=62 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:26:26.500334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585de-d8bb-4560-9bf7-5514157eef81 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:26.500857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585de-d8bb-4560-9bf7-5514157eef81 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:26.500857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f585de-d8bb-4560-9bf7-5514157eef81 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:26.502173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:26.506870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c743b-7b1a-4120-90f6-8482970b0d2c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:26.507183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c743b-7b1a-4120-90f6-8482970b0d2c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:26.507464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c743b-7b1a-4120-90f6-8482970b0d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:26.526819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8e0c743b-7b1a-4120-90f6-8482970b0d2c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:26.528011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8e0c743b-7b1a-4120-90f6-8482970b0d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:26.535700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:26.688152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f585de-d8bb-4560-9bf7-5514157eef81 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:26.702771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f585de-d8bb-4560-9bf7-5514157eef81 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:26.708173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:26.708796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:26.709079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:26.709357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:26.718008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:26.719585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1840aca-5a52-4b84-93a1-f74a533371c7 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:26.729187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 753/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:27.557481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049084b-513a-4d45-a4a0-885d7f2d7917 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.558088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049084b-513a-4d45-a4a0-885d7f2d7917 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.558088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049084b-513a-4d45-a4a0-885d7f2d7917 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.559528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 14:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:27.564351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39becc-5097-4a9a-9823-2cb9d5bdc74e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.564768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39becc-5097-4a9a-9823-2cb9d5bdc74e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.564966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39becc-5097-4a9a-9823-2cb9d5bdc74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.584253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ce39becc-5097-4a9a-9823-2cb9d5bdc74e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:27.585448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ce39becc-5097-4a9a-9823-2cb9d5bdc74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:27.593666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:27.672412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfcae-2d37-4b2f-a2b4-23e9210bdfa8 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.672723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfcae-2d37-4b2f-a2b4-23e9210bdfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.673065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfcae-2d37-4b2f-a2b4-23e9210bdfa8 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.674644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 770/1524] 10.222.0.13 () {54 vars in 960 bytes} [Fri Jun 24 14:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:27.679571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.679927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.680304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.699126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:27.700416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:27.708811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 755/1525] 10.222.0.13 () {58 vars in 1057 bytes} [Fri Jun 24 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:27.716319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bfcae-2d37-4b2f-a2b4-23e9210bdfa8 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:27.729980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bfcae-2d37-4b2f-a2b4-23e9210bdfa8 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:27.734800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:27.735457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.735736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.736007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.745154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:27.747105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4212ed-7ab3-4d63-9341-e070aa5e8f69 service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:27.747919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:27.757457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 771/1526] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:27.760961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3889d-d4d1-44ac-b997-6e05770b7d48 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:27.766247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:27.766877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:27.767149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:27.767420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:27.775890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:27.777558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b229-4e98-4d44-961e-a121551f7fc3 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:27.787024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 756/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:26:31.937029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada201f9-c643-4b06-b302-444abb74166a None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:31.937678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada201f9-c643-4b06-b302-444abb74166a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:31.937678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada201f9-c643-4b06-b302-444abb74166a None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:31.939061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:31.945419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968e66-5415-475a-ae7c-1b20991aebe9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:31.946178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968e66-5415-475a-ae7c-1b20991aebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:31.946178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d968e66-5415-475a-ae7c-1b20991aebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:31.964561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8d968e66-5415-475a-ae7c-1b20991aebe9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:31.965773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8d968e66-5415-475a-ae7c-1b20991aebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:31.974053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:32.012204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada201f9-c643-4b06-b302-444abb74166a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:32.014187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ada201f9-c643-4b06-b302-444abb74166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:32.074163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada201f9-c643-4b06-b302-444abb74166a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:32.077814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:32.078465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:32.078748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:32.079022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:32.089252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:32.090756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34e32-3eb2-4a45-9c44-f43d5f998704 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:32.100249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 773/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:34.188418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fa56-5d05-4d3f-9cdc-b41911cb586b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:34.191114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fa56-5d05-4d3f-9cdc-b41911cb586b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:34.191114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fa56-5d05-4d3f-9cdc-b41911cb586b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:34.191114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:34.195792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7172-1b50-44fd-aa33-4e924aabd3c9 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:34.196260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7172-1b50-44fd-aa33-4e924aabd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:34.196400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef7172-1b50-44fd-aa33-4e924aabd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:34.214795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-36ef7172-1b50-44fd-aa33-4e924aabd3c9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:34.216041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-36ef7172-1b50-44fd-aa33-4e924aabd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:34.223893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:34.260258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fa56-5d05-4d3f-9cdc-b41911cb586b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:34.271190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fa56-5d05-4d3f-9cdc-b41911cb586b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:34.275300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:34.275943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:34.276281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:34.276560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:34.285596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:34.287021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b2df5-31fc-452b-86ac-56e832c62374 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:34.297022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 759/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:38.051122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:38.051661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:38.051661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:38.053071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:38.058206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783144-476a-464e-9ff2-01e4b28f63b6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:38.058666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783144-476a-464e-9ff2-01e4b28f63b6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:38.058946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783144-476a-464e-9ff2-01e4b28f63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:38.076741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9f783144-476a-464e-9ff2-01e4b28f63b6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:38.077923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9f783144-476a-464e-9ff2-01e4b28f63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:38.085583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:38.397017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:38.398846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:38.457521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7edd-ff46-4f67-8101-9d94feae6091 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:38.461310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:38.461953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:38.462851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:38.463124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:38.472444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:38.473879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ed088-9806-4c4b-aa57-4a9a2ae0e5ac service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:38.483707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 776/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:40.565996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:40.566502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:40.566631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:40.567914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 14:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:26:40.574242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f5a4-f6ee-4bcb-a4dd-d0575586d2b2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:40.574747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f5a4-f6ee-4bcb-a4dd-d0575586d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:40.574851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f5a4-f6ee-4bcb-a4dd-d0575586d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:40.595850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b6d2f5a4-f6ee-4bcb-a4dd-d0575586d2b2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:26:40.597095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b6d2f5a4-f6ee-4bcb-a4dd-d0575586d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:40.605816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:26:40.909149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:26:40.910811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:26:40.924221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4c14-3ba8-4bf9-b370-ff710036f85b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:26:40.927708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:26:40.928363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:26:40.928650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:26:40.928923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:26:40.938786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:26:40.940246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8553-5c2f-43d6-94f3-7c29d3aa2771 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:26:40.951138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 762/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:26:50.589805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=67 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:26:50.946135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=36 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:21.590535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:21.591190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:21.591190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:21.625106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:21.626536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:21.639877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 778/1540] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:21.651914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:21.654774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:21.654774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:21.681041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:21.682250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:21.695090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 763/1541] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:21.699878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:21.720600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1ad7-9f16-4d78-a0ad-3e52de9b4aa4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:21.727050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:21.728271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:21.728796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:21.729289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:21.730240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:21.730771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:21.732706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:21.752682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 779/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:21.761406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:21.785729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495db31f-adb8-4a2f-8b70-5ffc247a4789 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:21.792580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:21.793263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:21.793547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:21.793822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:21.794535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:21.796708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:21.855562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 764/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:21 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:21.859541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:21.877750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e972-94a8-4cd9-bfac-698bc14b07e9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:21.973286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:21.974377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:21.974883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:21.975426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:21.976372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:21.978975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383c49-5f17-4b9f-8f30-42e757015fe4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.022257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 780/1544] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:21 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:22.025581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.035270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eef5-c1f7-4356-a107-b414c6b0085a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.035935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eef5-c1f7-4356-a107-b414c6b0085a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.036592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eef5-c1f7-4356-a107-b414c6b0085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.045782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213316e3-f1a8-4568-9199-46d26103e8ac admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.069145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-88f7eef5-c1f7-4356-a107-b414c6b0085a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.069629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.070344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.070628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.070906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.071902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.072263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-88f7eef5-c1f7-4356-a107-b414c6b0085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.074155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.089047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 781/1545] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.100055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 765/1546] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:22.101466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.101988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.102752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.104302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.122418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f6318-2a48-4832-bf41-0ed00c416815 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.137513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.139118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.142124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.142806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.143087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.143360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.144116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.145737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.156175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 782/1547] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.162046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.170676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 766/1548] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:22.173033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.177938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba871f-2d7a-4399-887d-1f7f6657d8c6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.186163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb68bc-cc63-43bf-ac4f-c6c3c93ccb43 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.190065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.191083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.191586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.192100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.193298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.193825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.195912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd926-dfa5-419b-aa90-661a85f7d3e3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.203388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.204580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.204811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.205084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] PATH_INFO: `/v3/projects/2d5600e2a31d4bffa9a2d5b87f605bcd/users/d39a17af7fa84627b4d3e6543000ef27/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.217786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 783/1549] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:28:22.220166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f221bf-132e-4327-b668-f036c8ab8db3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.220740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f221bf-132e-4327-b668-f036c8ab8db3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.221235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f221bf-132e-4327-b668-f036c8ab8db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.267724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5600e2a31d4bffa9a2d5b87f605bcd, user_id=d39a17af7fa84627b4d3e6543000ef27, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.270924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.285063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-32f221bf-132e-4327-b668-f036c8ab8db3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.287019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-32f221bf-132e-4327-b668-f036c8ab8db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.296288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 767/1550] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:22 2022] PUT /identity/v3/projects/2d5600e2a31d4bffa9a2d5b87f605bcd/users/d39a17af7fa84627b4d3e6543000ef27/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:22.298144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.358669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 784/1551] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.360520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcd1c-8886-46d3-b32f-9b74236443b8 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.360802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcd1c-8886-46d3-b32f-9b74236443b8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.361073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcd1c-8886-46d3-b32f-9b74236443b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.370738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed358-aebc-485e-81fe-34f32b275066 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.376081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.376663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.376939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.377206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.377888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.379333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ac3dcd1c-8886-46d3-b32f-9b74236443b8 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.379893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d9e2-a9d6-4ef2-91aa-bbdbb48849c3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.380582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ac3dcd1c-8886-46d3-b32f-9b74236443b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.388972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 785/1552] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.390196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab7bb-20de-4042-9a86-ef614812c35f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.390480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab7bb-20de-4042-9a86-ef614812c35f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.390762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab7bb-20de-4042-9a86-ef614812c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.408886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c0fab7bb-20de-4042-9a86-ef614812c35f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.410064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c0fab7bb-20de-4042-9a86-ef614812c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.419365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 768/1553] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:22.419365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e31e-dc06-4782-8685-9d4e10366244 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.419365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e31e-dc06-4782-8685-9d4e10366244 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.419365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e31e-dc06-4782-8685-9d4e10366244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.421241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 786/1554] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.423006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e524-80cc-4120-83d3-352da33b794a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.423298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e524-80cc-4120-83d3-352da33b794a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.423569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2e524-80cc-4120-83d3-352da33b794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.438984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cf44e31e-dc06-4782-8685-9d4e10366244 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.440233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cf44e31e-dc06-4782-8685-9d4e10366244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.443669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d0d2e524-80cc-4120-83d3-352da33b794a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.444863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d0d2e524-80cc-4120-83d3-352da33b794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.470225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:22.502117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 769/1555] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.503444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4143-b5aa-42ad-be6a-635629d5eadd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.503683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4143-b5aa-42ad-be6a-635629d5eadd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.503959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4143-b5aa-42ad-be6a-635629d5eadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.504967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 787/1556] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.509589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ee9-071f-438b-b642-749b102dc587 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.510474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ee9-071f-438b-b642-749b102dc587 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.510759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47ee9-071f-438b-b642-749b102dc587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.523255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c80a4143-b5aa-42ad-be6a-635629d5eadd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.524521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c80a4143-b5aa-42ad-be6a-635629d5eadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.529198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9fd47ee9-071f-438b-b642-749b102dc587 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.530376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9fd47ee9-071f-438b-b642-749b102dc587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.532855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 770/1557] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.534062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.534343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.534623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.541590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:22.542510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 788/1558] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.543943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d934b5-645c-4569-b4e2-adf8a9a7a8e6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.544267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d934b5-645c-4569-b4e2-adf8a9a7a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.544538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d934b5-645c-4569-b4e2-adf8a9a7a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.559132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.560798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.562271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-22d934b5-645c-4569-b4e2-adf8a9a7a8e6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.563481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-22d934b5-645c-4569-b4e2-adf8a9a7a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.569870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 771/1559] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.570613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.571348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 789/1560] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.572566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27886-0a54-4b85-a753-6aa9308b7d9f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.572852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27886-0a54-4b85-a753-6aa9308b7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.573129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27886-0a54-4b85-a753-6aa9308b7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.585127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f09a96-d455-423e-9004-1c07397c1d76 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.589821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.590482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.590762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.591036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.591725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.592445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-92f27886-0a54-4b85-a753-6aa9308b7d9f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.592950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:22.592950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:28:22.592950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:28:22.593628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-92f27886-0a54-4b85-a753-6aa9308b7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.594616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600b9e-2efe-430f-80f6-d6a6db7ce91e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.601967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 790/1561] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.603572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.604117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.604240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.618772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 772/1562] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:22.620210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f688-dc06-431e-845d-e85f52288605 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.620497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f688-dc06-431e-845d-e85f52288605 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.620770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286f688-dc06-431e-845d-e85f52288605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.623399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.624620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.633112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 791/1563] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.633823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.639158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4286f688-dc06-431e-845d-e85f52288605 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.640392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4286f688-dc06-431e-845d-e85f52288605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.648728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 773/1564] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.650104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.650387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.650658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.668598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:22.669764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:22.677538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 774/1565] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:22.678373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.687445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a6fef-5793-44f0-b0ac-873f8965dcc4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.691949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.692555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5e21-1e2c-4de7-bec8-28cb87943eb2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.692707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.692864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.693137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.693849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.694153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.695153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:22.695153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:28:22.695153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:28:22.696052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.696292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.696935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.697215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.697682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.707303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.707815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 775/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.708756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.713058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.717982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2af-50e3-4d52-8403-898fd0cfc20b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.722999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.723613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.723892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.724197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.724585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 792/1567] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:22.724988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.725292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.725396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.726959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.735956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cf1b-a4c3-4d19-aee5-ae680ad55209 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.744538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 776/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.744538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.744807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.744807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.744807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.744807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.745115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.745115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.745115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.753793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0f5d4-0eca-43fd-a8f3-f83255d6447d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.758815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.759464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.759889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.760114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.760255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 793/1569] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.760828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.761087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.762506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.774188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edd5b-903b-4966-85cc-7c494b4b85a7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.780727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 777/1570] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:22.780727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.782929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.783587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.783881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.784224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.784961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.785268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.786923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.790646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41826ae-b521-42ac-8f39-6c0c0df0f8f7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.796073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.796886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.797462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.797754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.798626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.799082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.801256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.801502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 794/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.802295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.812500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba9b8f-f54a-4d65-bafa-a279a791bb0e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.823080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 778/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.823080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.827833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.829208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.829556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.829933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.830800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:22.831177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.832926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.836479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856acd5-ccea-4ab5-8f16-28f4876eaa6d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.841987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.842799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.843055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.843334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.844125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.846057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.848855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 795/1573] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:22.850050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.861296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fa8b-4e97-4140-aa5b-4c540380be18 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.865923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.866602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.867015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.867298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.867990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.869050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:22.869050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:28:22.869050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:28:22.870378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:22.886976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 779/1574] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:22.886976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.906485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 796/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:22.907325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:22.966950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:22.967342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003937-21ab-4ff9-aa46-94b072059666 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.984611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b94b-38f8-4bdb-9138-a46a4cfaf83e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:22.989963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:22.990757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:22.991216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:22.991501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:22.992276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:22.993937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.004944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 797/1576] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.005771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.018847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ccfe-8ad8-4d2a-ae64-fcd404ff30f6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.024502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.025162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.025497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.025781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.026531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.028591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.044514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.046174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.046621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.046971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.047828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.049932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.059146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:23.076951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 798/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.077842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.089579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 780/1578] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:22 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.089579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.164368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeeea7-6ba0-4e84-96c1-05dd815f0075 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.181562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df512-fd6c-4c4b-a3ea-6cb9b7b694cf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.189033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.189787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.190136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.190762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.192884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.196260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.239837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 781/1579] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.240814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.243926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.244694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.245043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.245380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.246142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.248277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.280496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 799/1580] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.280496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.319235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de1e5c-c25c-4478-ac2e-5022be0a0ac5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.338582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:23.352790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640ef7-3570-46a7-b4ee-bc58856d52a7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.359618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.360477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.360827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.361107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.361890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.363851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.391620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 800/1581] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.392264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.396962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.397879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.398366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.399206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.399594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.401653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.403465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062816d-63de-4bd0-b2d9-0aae77d036ad admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.409335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.410204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.411040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.411040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] PATH_INFO: `/v3/projects/68acaba5663245e08dfbc28ce0f79de4/users/6117bb7bf42f4027b2d06d5ef3749acf/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.432060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 782/1582] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.432060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.432244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68acaba5663245e08dfbc28ce0f79de4, user_id=6117bb7bf42f4027b2d06d5ef3749acf, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.432244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:23.432244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:28:23.432244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:28:23.434190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.442225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bc3a-e8fb-4c05-bf04-51ddb373c812 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.447318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:23.450709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 801/1583] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:23 2022] PUT /identity/v3/projects/68acaba5663245e08dfbc28ce0f79de4/users/6117bb7bf42f4027b2d06d5ef3749acf/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:23.461527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.526617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.526865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.527170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.527513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.528330 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.530630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.546613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfe7a-03fc-480a-bc3e-5a2282233fa7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.556234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.556786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 783/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 302 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.558067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.558463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.558882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.559922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.565389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.571212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.587474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abb27-536a-403b-a7b9-560cc2eb46fd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.592700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.593370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.593654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.593975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.594661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.596632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.606842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 802/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.607854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.630370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 784/1586] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.630370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.630611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9659307-2b7f-4ab4-9f27-cd89b3112e4c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.637537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.638395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.638680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.638950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.640142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.641411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507e6f-98de-4127-a7c9-dbaa1c56f072 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.643550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518515-6920-4d7b-b35d-6a8016299097 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.646576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.647699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.648206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.648644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.650234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.652052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.669074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 785/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.670690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.676425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 803/1588] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.677400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.677691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.677967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.687219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555442e8-f0a3-4404-a604-e2933bfa6576 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.692535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.693187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.693460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.693733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.694452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.696225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.709001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 786/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.710003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.718429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] MFA Rules not processed for user `6117bb7bf42f4027b2d06d5ef3749acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:23.720742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:23.720987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97a1-b1a5-4616-8874-5faa26c0407e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.725785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.726545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.726826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.727104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.729480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.730011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.742370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 787/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.743361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.757663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8844b-d0f7-4912-a450-932226ea303c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.762781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.763577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.763861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.764351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.765125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.767281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.782759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 788/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.783989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.795309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa43c-471a-4a15-9fdd-7fd1700a13cd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.801771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.802451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.802853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.803142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.804180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.808279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 804/1592] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:23.808442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.808547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.817444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d40c2-0c4e-4dd7-8594-8545d9ac2059 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.827283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.827283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.827283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.827283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.827831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.828781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 789/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.829343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.830689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.842761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 805/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.843751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.847206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c2db-7cc5-48d5-94d1-b413a809b1c7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.853587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.854266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.854830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.855113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.855848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.857312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e810-dee4-40db-90d0-f46be4e5362f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.857533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.864653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.865423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.865772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.866172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.866986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.868618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.870949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:23.880366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 790/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.881247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.886806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 806/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.887937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.899735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e9b2-c66f-4251-8708-36117dbaaff2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.902830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0e09-9d4d-44c9-be25-6f7e1948236e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.907404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.908148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.908501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.908843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.909626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.910148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.910822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.911108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.911386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.911661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.912155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.913903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.923439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 791/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.924606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.930157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 807/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.930157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.935157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee309-8826-40c4-a709-5f3415a26dda admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.939099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9e72-ad68-4935-beb0-80b2726253dc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.945543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.945794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.946876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.947001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.947392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.947677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.947784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.948446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.948811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.949681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:23.951419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.952455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:23.970856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 808/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:23.970856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:23.983692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314cff-8ba6-4adb-b1f3-c98bfb38fe6d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:23.989206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:23.990230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:23.990644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:23.991364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] PATH_INFO: `/v3/projects/89e81889a7454bd7a8e170cd138cdcd4/users/e60973c18e0b433c94f3fcb293303392/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:23.994482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 792/1600] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:23 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:23.995398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.012248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e81889a7454bd7a8e170cd138cdcd4, user_id=e60973c18e0b433c94f3fcb293303392, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.015706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.032894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 809/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:23 2022] PUT /identity/v3/projects/89e81889a7454bd7a8e170cd138cdcd4/users/e60973c18e0b433c94f3fcb293303392/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.034213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.061911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:24.092440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5cd3c-f46e-49a6-a527-7bf6d6e28a07 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.127080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f93783-9095-4d86-ba69-c16b4aa08402 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.132760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.133862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.134318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.134768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] PATH_INFO: `/v3/projects/f644afc12eb54b2eaeec92d9f154f490/users/32a564c2e69a44ec97fa6996b259bd68/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.151486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f644afc12eb54b2eaeec92d9f154f490, user_id=32a564c2e69a44ec97fa6996b259bd68, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.154235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.173267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.174293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.174816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.178511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 810/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:24 2022] PUT /identity/v3/projects/f644afc12eb54b2eaeec92d9f154f490/users/32a564c2e69a44ec97fa6996b259bd68/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.178511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.179496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.180698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.182606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.196087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 793/1603] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:24.197235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.207735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5061-5e6d-4cb5-98a3-5a533b2e9735 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.285899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.287703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.288186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.288614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] PATH_INFO: `/v3/projects/aeb6d5b470a24eb9aa3951b7bc53bdae/users/9f8192ea4a174253afcebaf6f9d206c9/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.288981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bee12d-c3b7-4356-8278-a67543fdcfca admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.295293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.296288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.296564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.296844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] PATH_INFO: `/v3/projects/7e87a9892adc48e59b08bbbe7cb8217f/users/99e640669f734554abc4b05c0f916d6d/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.311864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb6d5b470a24eb9aa3951b7bc53bdae, user_id=9f8192ea4a174253afcebaf6f9d206c9, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.315011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e87a9892adc48e59b08bbbe7cb8217f, user_id=99e640669f734554abc4b05c0f916d6d, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.316047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.318179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.333797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 794/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:24 2022] PUT /identity/v3/projects/aeb6d5b470a24eb9aa3951b7bc53bdae/users/9f8192ea4a174253afcebaf6f9d206c9/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.335020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.340186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 811/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:24 2022] PUT /identity/v3/projects/7e87a9892adc48e59b08bbbe7cb8217f/users/99e640669f734554abc4b05c0f916d6d/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.341409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.372263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:24.442371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698a26-fec8-42fb-b33c-dc542db76ee7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.443530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9ee2-d048-483c-97ba-fd26c650cf60 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.448182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.448530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.448876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.449158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.449281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.449437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] PATH_INFO: `/v3/projects/f951af27cb024675ace1fa57a2daf5f5/users/4ae63f089859454099148563e7765e6b/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.449537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.449730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.450822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.452466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241502-faa9-4ac7-8270-27a7815bee8f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.463775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:24.468325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f951af27cb024675ace1fa57a2daf5f5, user_id=4ae63f089859454099148563e7765e6b, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.471945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1813-6bf3-4a74-a437-057277da867b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.476320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 812/1606] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:24.478102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.478674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.478989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.492714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 795/1607] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:24 2022] PUT /identity/v3/projects/f951af27cb024675ace1fa57a2daf5f5/users/4ae63f089859454099148563e7765e6b/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.494397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c98-6cf6-4cd8-aa8c-4d290f22572d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.494886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c98-6cf6-4cd8-aa8c-4d290f22572d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.495319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c98-6cf6-4cd8-aa8c-4d290f22572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.512795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] MFA Rules not processed for user `e60973c18e0b433c94f3fcb293303392`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.514094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.516808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0b550c98-6cf6-4cd8-aa8c-4d290f22572d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.518156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0b550c98-6cf6-4cd8-aa8c-4d290f22572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.597567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 813/1608] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:24.608873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.611538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 796/1609] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:24.613249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e93b0-25f0-4a6c-b528-39864b177ad2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.613548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e93b0-25f0-4a6c-b528-39864b177ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.613873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e93b0-25f0-4a6c-b528-39864b177ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.623483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc3cd-c0cb-4ace-9234-672e3cd73e54 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.629785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.630700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.630984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.631261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] PATH_INFO: `/v3/projects/449b696e1a994626a5854edbcd9f7649/users/3457e2d9157a451ba09567666d577154/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.711647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449b696e1a994626a5854edbcd9f7649, user_id=3457e2d9157a451ba09567666d577154, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.711647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-678e93b0-25f0-4a6c-b528-39864b177ad2 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-678e93b0-25f0-4a6c-b528-39864b177ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 797/1610] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.712300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.713355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 814/1611] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:24 2022] PUT /identity/v3/projects/449b696e1a994626a5854edbcd9f7649/users/3457e2d9157a451ba09567666d577154/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:24.713355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.727716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.729491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.804612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0230b-ff66-42d2-9d08-beef7873a090 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.809825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.810505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.810786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.811062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.811872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.813644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafac29-2f11-47f1-ba48-394c2b3ca7ff admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.826470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 815/1612] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:24.829112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6e40-c5d7-4854-b5da-d540250c6305 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.830815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6e40-c5d7-4854-b5da-d540250c6305 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.831206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6e40-c5d7-4854-b5da-d540250c6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.838278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 798/1613] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:24.838278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.853888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:24.864848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-187c6e40-c5d7-4854-b5da-d540250c6305 None None] MFA Rules not processed for user `4ae63f089859454099148563e7765e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.866477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-187c6e40-c5d7-4854-b5da-d540250c6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.912133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6871e5-b03d-498c-b542-07ebbbfe7584 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:24.916249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:24.916906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.917190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.917470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.930050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:24.931902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae78c-45f0-4359-9d29-7e11222f5035 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:24.943918 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 799/1614] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:24.945315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6bfd-f6d5-4a15-ac79-4e1a50cfcfc1 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.945608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6bfd-f6d5-4a15-ac79-4e1a50cfcfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.945890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6bfd-f6d5-4a15-ac79-4e1a50cfcfc1 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.950981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 800/1615] 10.222.0.13 () {54 vars in 961 bytes} [Fri Jun 24 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:24.950981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6bfd-f6d5-4a15-ac79-4e1a50cfcfc1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:24.952239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 816/1616] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:24.954552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:24.955023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:24.955579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:24.981022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:24.983251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:24.984074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6bfd-f6d5-4a15-ac79-4e1a50cfcfc1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.001968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.002557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.003098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 817/1617] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:25.004560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.004935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.005343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.017765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483d8e-63cb-4e2c-b1b9-4341e2aff2ff None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.019310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.021120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.023836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.024896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.025182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.025460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] PATH_INFO: `/v3/projects/9a6aaa2021d5417faf9d9359a96ee930/users/34c2caa2aafa4d04b65c29de5db8eb0a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.034227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 801/1618] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:25.035331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.044152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdefab8-a303-4201-9d3a-a0bba498c8d2 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.049385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6aaa2021d5417faf9d9359a96ee930, user_id=34c2caa2aafa4d04b65c29de5db8eb0a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.052158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210f729-f227-47f0-9d6f-e4d9e58ff586 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.053619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.054476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.054938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.055377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.067704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.069602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed79c89-809e-4708-8db9-78ed247ce378 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.080275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 818/1619] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:25 2022] PUT /identity/v3/projects/9a6aaa2021d5417faf9d9359a96ee930/users/34c2caa2aafa4d04b65c29de5db8eb0a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:25.082090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.082536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.083091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.088123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 802/1620] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:25.089587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1810-af6d-43da-bc67-497da76d1eb0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.089885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1810-af6d-43da-bc67-497da76d1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.090352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1810-af6d-43da-bc67-497da76d1eb0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.092420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 803/1621] 10.222.0.13 () {54 vars in 961 bytes} [Fri Jun 24 14:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:25.093123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb1810-af6d-43da-bc67-497da76d1eb0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.099874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:25.111318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:25.112845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:25.175677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb1810-af6d-43da-bc67-497da76d1eb0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.182661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.183839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.185355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.185699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.236622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 819/1622] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Jun 24 14:28:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:25.237861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.311661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.314097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81885-6daf-4d29-b71f-93fa2dd572fd service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.326238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 804/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:25.327589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.327881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.328827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.353507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a959a8-9afa-4477-ad20-bb88914f69ad None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.353847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:25.355606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:25.362298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.363639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.364641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.365137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.365989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.368138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.369755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:25.373977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 805/1624] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Jun 24 14:28:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:25.376114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.387825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 820/1625] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:25.387825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.395546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247c1e-2407-4a4a-b446-657d67d338d4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.402591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.403509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.403965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.404454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.405359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef91a0b-722c-4643-b89c-62effe2e8050 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.419061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.419931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.420517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.421230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.503526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.505321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.515012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.517630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b25a2-efb9-42d6-976d-3269239daee2 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.522442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 806/1626] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:25.523451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.533023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 821/1627] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:25.536223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df7ba4-96f5-41f5-bed1-7d0aa042f803 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.541802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.543339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.543729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.544422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] PATH_INFO: `/v3/projects/9a6aaa2021d5417faf9d9359a96ee930/users/34c2caa2aafa4d04b65c29de5db8eb0a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.547988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6aaa2021d5417faf9d9359a96ee930, user_id=34c2caa2aafa4d04b65c29de5db8eb0a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.551145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:25.580091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 807/1628] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:25 2022] PUT /identity/v3/projects/9a6aaa2021d5417faf9d9359a96ee930/users/34c2caa2aafa4d04b65c29de5db8eb0a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:25.583592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0391de-92a4-42be-8ba5-96ff476a64b2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.584223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0391de-92a4-42be-8ba5-96ff476a64b2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.584663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0391de-92a4-42be-8ba5-96ff476a64b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.620953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ca0391de-92a4-42be-8ba5-96ff476a64b2 None None] MFA Rules not processed for user `34c2caa2aafa4d04b65c29de5db8eb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:25.626969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ca0391de-92a4-42be-8ba5-96ff476a64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:25.813576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 822/1629] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:25.823701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:25.892203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:25.914370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09d3e-b3b1-4a32-a3af-272365606f43 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.914738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09d3e-b3b1-4a32-a3af-272365606f43 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.914996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09d3e-b3b1-4a32-a3af-272365606f43 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.916656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 823/1630] 10.222.0.13 () {54 vars in 912 bytes} [Fri Jun 24 14:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:25.922955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.923241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.923515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.944457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:25.946870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:25.967962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce215c-79ef-4100-882a-db03c431ed2d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:25.973518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:25.975112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:25.976264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:25.977005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:25.994558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:25.996931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c817277-0f6a-4787-b86a-3d4eed964a18 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:26.016147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 808/1631] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:26.018557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b50a6-c94f-4339-ab57-9ce7d1007398 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:26.019036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b50a6-c94f-4339-ab57-9ce7d1007398 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:26.019523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b50a6-c94f-4339-ab57-9ce7d1007398 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:26.024989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 809/1632] 10.222.0.13 () {54 vars in 912 bytes} [Fri Jun 24 14:28:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:26.032259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:26.032632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:26.032972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:26.077298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:26.078825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:26.104610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 824/1633] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:28:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:26.106491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 810/1634] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:28:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:26.106780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:26.120098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5053fc5-397d-4357-94c4-1a368ade97a3 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:26.123992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:26.124881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:26.125204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:26.125473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:26.139952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:26.142013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:26.148768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:26.171835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 825/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:26.173601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:26.186215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9215e-c191-4f31-88b1-9caebcac26d2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:26.190373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:26.191376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:26.191660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:26.191981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:26.211189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:26.212738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3e6f7-636a-4b80-8f81-90512da6d968 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:26.226002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 811/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:27.239771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:27.253218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d249-58db-412a-a38d-bd82d100ff64 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:27.264269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:27.265354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:27.265803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:27.266737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:27.418256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:27.419868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:27.455327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 826/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:28.731433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:28.732038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:28.733631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:28.794599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] MFA Rules not processed for user `99e640669f734554abc4b05c0f916d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:28.796500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:29.036412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 812/1638] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:29.041085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:29.255498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c8af6-3f95-4b4b-8eaf-d4cd96de322d service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:29.271325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:29.272037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:29.272335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:29.272617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:29.273334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:29.295338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:29.387869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 827/1639] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:29 2022] POST /identity/v3/projects => generated 401 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:29.391846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:29.413834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72949f43-1987-4150-8eb1-a5ac7efb7910 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:29.568743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:29.569444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:29.569827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:29.570104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:29.570823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:29.572833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:29.616364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 813/1640] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:29 2022] POST /identity/v3/users => generated 307 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:29.619969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:29.641305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d301f-8a53-43fe-b939-152c46430f82 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:29.657536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:29.659329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:29.659639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:29.659904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:29.660684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:29.662314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:29.719861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 828/1641] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:29.721070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:29.749409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470129-e4dc-4385-b6c3-ec8364f9dba9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:29.774602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:29.775852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:29.776474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:29.776474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] PATH_INFO: `/v3/projects/729d0f924a8b4e13ab5e09903e9fa643/users/e67ee2aa4dd54f5db6e005e64fee6662/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:29.835148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729d0f924a8b4e13ab5e09903e9fa643, user_id=e67ee2aa4dd54f5db6e005e64fee6662, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:29.840320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:29.888003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 814/1642] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:29 2022] PUT /identity/v3/projects/729d0f924a8b4e13ab5e09903e9fa643/users/e67ee2aa4dd54f5db6e005e64fee6662/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:29.889435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:29.915720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b652-05e7-46dc-9d72-452d535ceb18 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:30.169086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:30.170762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:30.171184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:30.171752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:30.174296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:30.176291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:30.215085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:30.247238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 829/1643] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:30.262490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8187d4-f6b9-451b-9f4f-a4c17e7fa2d0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:30.340387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:30.341299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:30.344527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:30.344844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] PATH_INFO: `/v3/projects/729d0f924a8b4e13ab5e09903e9fa643/users/e67ee2aa4dd54f5db6e005e64fee6662/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:30.357434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729d0f924a8b4e13ab5e09903e9fa643, user_id=e67ee2aa4dd54f5db6e005e64fee6662, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:30.392013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:30.394020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b340a6-33b2-4ff4-ac89-6cac5b514d51 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:30.410879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40829a-9379-423e-9ff8-79f119230890 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:30.414779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:30.421961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:30.423464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:30.424126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:30.424555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] PATH_INFO: `/v3/users/e60973c18e0b433c94f3fcb293303392` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:30.427264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60973c18e0b433c94f3fcb293303392)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:30.428539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: WARNING py.warnings [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:30.428539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: warnings.warn(msg) Jun 24 14:28:30.428539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: Jun 24 14:28:30.431015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:30.434165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:30.459196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 815/1644] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:30 2022] PUT /identity/v3/projects/729d0f924a8b4e13ab5e09903e9fa643/users/e67ee2aa4dd54f5db6e005e64fee6662/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:30.596659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60973c18e0b433c94f3fcb293303392'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:30.599504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60973c18e0b433c94f3fcb293303392'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:30.650300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60973c18e0b433c94f3fcb293303392'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:30.673385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60973c18e0b433c94f3fcb293303392'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:30.674630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-51d4d310-b2f3-42cf-b85e-ce8ece8997f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60973c18e0b433c94f3fcb293303392'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:30.742431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 830/1645] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:30 2022] DELETE /identity/v3/users/e60973c18e0b433c94f3fcb293303392 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:30.747300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:30.747591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:30.747909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:30.799991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:30.802058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:30.850969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:30.851276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:30.851539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:30.917628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 816/1646] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:30.919205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:30.922855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:30.929763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] MFA Rules not processed for user `d39a17af7fa84627b4d3e6543000ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:30.931576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:31.012683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9069f2-5b9d-44a1-8584-a93ba3bfded7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:31.024509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:31.025579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:31.026031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:31.026675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:31.060751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:31.062329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:31.082413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 817/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:31.112558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 831/1648] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:31.123698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:31.126141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:31.271913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631cf92-10ee-4cd4-be3e-d7fa5d1bfe0c service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:31.299770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:31.303464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:31.303975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:31.304481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:31.336382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:31.338496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1c624-20ff-4c0f-9e88-001795e3a5c5 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:31.383491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 818/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:31.620062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:31.622247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:31.671386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f35e5-ed0d-40ee-acbe-e85d920a1c40 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:31.685977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:31.686867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:31.688205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:31.689073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] PATH_INFO: `/v3/projects/89e81889a7454bd7a8e170cd138cdcd4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:31.693206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e81889a7454bd7a8e170cd138cdcd4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:31.697743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:31.792829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e81889a7454bd7a8e170cd138cdcd4', 'request_id': 'req-e95d413c-8141-4359-a473-45f418445a59'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:31.801667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e81889a7454bd7a8e170cd138cdcd4', 'request_id': 'req-e95d413c-8141-4359-a473-45f418445a59'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:31.810564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:31.819616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e81889a7454bd7a8e170cd138cdcd4', 'request_id': 'req-e95d413c-8141-4359-a473-45f418445a59'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:31.844917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] The token cache is being invalidate because project 89e81889a7454bd7a8e170cd138cdcd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:28:31.845474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:31.848224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e95d413c-8141-4359-a473-45f418445a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:31.850455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 832/1650] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:28:31 2022] DELETE /identity/v3/projects/89e81889a7454bd7a8e170cd138cdcd4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:31.855805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:31.856366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:31.856366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:31.893848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:31.897154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:31.954693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:32.103380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 819/1651] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:32.113023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.113314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.113592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.161157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:32.164547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:32.180352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 833/1652] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:32.184382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.201203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6cb5-1a71-4fc1-b316-639e3d726dc4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.209337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.210202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.210582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.210956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.211795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:32.227703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.230047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.244417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 820/1653] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:32.248734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.259573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8a37-9a1a-4c9b-949d-4b624e0f8e79 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.268177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.270764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.271219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.271695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.272906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.276620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.347046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.348190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 834/1654] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:32 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:32.359020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50686005-7b05-4613-8fd3-7abad6f6e85e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.483517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.484573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.484941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.485133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.497900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.500671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.557193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 821/1655] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:32 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:28:32.560916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.575980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b623b-b53f-4612-ae4d-2182fd60098c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.588269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.589059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.589394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.589732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.590612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.592554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.628115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 835/1656] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:32.629103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.647213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb963d-4ed7-4d55-bfb8-897bf94113a4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.661467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.665638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.666097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.667618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.671998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.676318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e898-0684-4fd4-98c6-7169ff94ac5c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.720362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 822/1657] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:32.722075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:32.735560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc761-1fdc-48bf-ba1c-936a90943d6a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:32.749834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:32.751646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.752159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.752637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] PATH_INFO: `/v3/projects/2ca424feb1544cd6aaeae2b002853e52/users/aaebe04870304ad994a183c436806ae3/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.784672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca424feb1544cd6aaeae2b002853e52, user_id=aaebe04870304ad994a183c436806ae3, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:32.787725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65173b-eae5-439a-81a3-1be988e3bb82 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:32.814841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.815183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.815440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.841075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 836/1658] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:32 2022] PUT /identity/v3/projects/2ca424feb1544cd6aaeae2b002853e52/users/aaebe04870304ad994a183c436806ae3/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:32.853898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:32.854632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:32.855180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:32.926425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] MFA Rules not processed for user `e67ee2aa4dd54f5db6e005e64fee6662`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:32.932626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:32.935747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] MFA Rules not processed for user `aaebe04870304ad994a183c436806ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:32.941665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:33.111880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 823/1659] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:33.127243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 837/1660] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:33.130405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:33.175108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:33.287274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595951db-6bdb-46ff-a9f0-02aa7b2e6587 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:33.302315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:33.303012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:33.303298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:33.304406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:33.305534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:33.307311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:33.377088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 824/1661] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:33 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:33.380615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:33.394253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3461-b227-4557-a4c3-d79b9c4dbbd5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:33.648325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:33.649099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:33.649434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:33.649712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:33.650432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:33.658947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:33.720814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 838/1662] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:33 2022] POST /identity/v3/users => generated 295 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:33.724490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:33.739306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f42a3e-b95b-40a7-9f07-82ec7b5eea7e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:33.764719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:33.765598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:33.765889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:33.766168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:33.766910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:33.768564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:33.801901 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 825/1663] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:33.806499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:33.825298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f841f-638b-4974-b512-eafa2a371216 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:33.837289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:33.838162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:33.838472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:33.838743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] PATH_INFO: `/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3/users/8b3d092268ab47cba7ca6114125302c4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:33.845682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:33.884816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7cb8dfc4a747cebb09b77c293980b3, user_id=8b3d092268ab47cba7ca6114125302c4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:33.892762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:33.957343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 839/1664] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:33 2022] PUT /identity/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3/users/8b3d092268ab47cba7ca6114125302c4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:33.960913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:33.982378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e01e-4863-4517-ace6-12218395964c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:34.140212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:34.141900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:34.142262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:34.142541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:34.143299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:34.147333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8e976-0ec0-4938-a8f2-a9564a55bc05 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:34.178594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 826/1665] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:34.182949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:34.204144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7d6c3-6bff-4cb9-a8ce-c5f12a10fcc9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:34.222500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:34.225794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:34.226228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:34.226504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] PATH_INFO: `/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3/users/8b3d092268ab47cba7ca6114125302c4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:34.239632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7cb8dfc4a747cebb09b77c293980b3, user_id=8b3d092268ab47cba7ca6114125302c4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:34.275875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:34.300902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 840/1666] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:34 2022] PUT /identity/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3/users/8b3d092268ab47cba7ca6114125302c4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:34.320382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:34.320834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:34.321262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:34.397765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] MFA Rules not processed for user `8b3d092268ab47cba7ca6114125302c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:34.402197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:34.584496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 827/1667] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:34.595972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:34.598647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:34.777301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1c3c-0182-423f-9bb0-4433b12a0ea6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:34.783312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:34.784109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:34.784516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:34.784801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:34.882576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:34.887031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67888a75-f69d-426e-b228-ebf2a57d0d21 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:34.934297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 841/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:35.278601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:35.280619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:35.303127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:35.386951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8fe7-0acd-4b03-ace8-e7687a1e4e57 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.388466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8fe7-0acd-4b03-ace8-e7687a1e4e57 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.391879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8fe7-0acd-4b03-ace8-e7687a1e4e57 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.394734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 842/1669] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:28:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:35.451229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d24a8-2039-4f21-a6cc-77b350f99238 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:35.462357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea8c1b-2f70-437e-9182-a61f5537659c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.462465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:35.463154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea8c1b-2f70-437e-9182-a61f5537659c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.463591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea8c1b-2f70-437e-9182-a61f5537659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.463697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.463946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.464440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] PATH_INFO: `/v3/users/4ae63f089859454099148563e7765e6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.466387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae63f089859454099148563e7765e6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:35.472187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:35.507389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-dfea8c1b-2f70-437e-9182-a61f5537659c None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:35.509191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-dfea8c1b-2f70-437e-9182-a61f5537659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:35.606792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae63f089859454099148563e7765e6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:35.659327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae63f089859454099148563e7765e6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:35.664972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae63f089859454099148563e7765e6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:35.666714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae63f089859454099148563e7765e6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:35.706664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6630754a-2fe3-43a3-91be-035a5715294a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae63f089859454099148563e7765e6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:35.780035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 828/1670] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:35 2022] DELETE /identity/v3/users/4ae63f089859454099148563e7765e6b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:35.786626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.786927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.796629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.800638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 843/1671] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:35.828912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:35.831156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:35.866010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0f5-9725-4dc0-939b-0add3f8b083c None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.866304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0f5-9725-4dc0-939b-0add3f8b083c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.866586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ba0f5-9725-4dc0-939b-0add3f8b083c None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.868268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 844/1672] 10.222.0.13 () {54 vars in 960 bytes} [Fri Jun 24 14:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:28:35.888096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:35.888429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:35.888757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:35.930445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:35.931634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:35.979188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:36.034771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 829/1673] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:36.165989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:36.167913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:36.185217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 845/1674] 10.222.0.13 () {58 vars in 1057 bytes} [Fri Jun 24 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:36.185878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:36.228958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856b9d-78fa-4941-84e8-9bee61bc615c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:36.240282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:36.240946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:36.241231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:36.241507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:36.255297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:36.256984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:36.278601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:36.294917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 846/1675] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:36.332378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc7d68-f5f7-411d-9503-9cf1861560a0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:36.336626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:36.337418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:36.337794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:36.338177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:36.365952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:36.367556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:36.393498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 830/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:38.434264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:38.435866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:38.557062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515ddd9-081d-4785-afa1-bebbcf21a2cf service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:38.567370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:38.568059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:38.568402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:38.568688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:38.572943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:38.698421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:38.703976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:38.736029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 847/1677] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:38.790656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:38.792334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:38.816880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c87cf-f98e-4daa-a5d9-df44045afe7c service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:38.833934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:38.834940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:38.837566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:38.837968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] PATH_INFO: `/v3/users/99e640669f734554abc4b05c0f916d6d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:38.840731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e640669f734554abc4b05c0f916d6d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:38.842968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:38.981107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e640669f734554abc4b05c0f916d6d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.021256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:39.024888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:39.063274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e640669f734554abc4b05c0f916d6d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.064818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e640669f734554abc4b05c0f916d6d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.065889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e640669f734554abc4b05c0f916d6d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.079633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fedf9-0180-4a9e-aa03-09ce192d683e service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:39.099045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d0529a0e-886a-4fc7-9718-2a47b94dabba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e640669f734554abc4b05c0f916d6d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.099347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:39.101994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:39.105422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:39.105857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] PATH_INFO: `/v3/projects/f951af27cb024675ace1fa57a2daf5f5` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:39.114009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f951af27cb024675ace1fa57a2daf5f5)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:39.116200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:39.198115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 831/1678] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:38 2022] DELETE /identity/v3/users/99e640669f734554abc4b05c0f916d6d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:39.206900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b395-bbf3-4888-ba5c-c719a9e397ad None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:39.206900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b395-bbf3-4888-ba5c-c719a9e397ad None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:39.206900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b395-bbf3-4888-ba5c-c719a9e397ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:39.253379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f226b395-bbf3-4888-ba5c-c719a9e397ad None None] MFA Rules not processed for user `d39a17af7fa84627b4d3e6543000ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:39.257017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f226b395-bbf3-4888-ba5c-c719a9e397ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:39.308745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:39.311554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f951af27cb024675ace1fa57a2daf5f5', 'request_id': 'req-0a0fe121-f857-46c0-9c52-85100a9b5734'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.353677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f951af27cb024675ace1fa57a2daf5f5', 'request_id': 'req-0a0fe121-f857-46c0-9c52-85100a9b5734'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.380837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f951af27cb024675ace1fa57a2daf5f5', 'request_id': 'req-0a0fe121-f857-46c0-9c52-85100a9b5734'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.430240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] The token cache is being invalidate because project f951af27cb024675ace1fa57a2daf5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:28:39.430568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.432868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0a0fe121-f857-46c0-9c52-85100a9b5734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:39.440448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 848/1679] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:28:39 2022] DELETE /identity/v3/projects/f951af27cb024675ace1fa57a2daf5f5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:39.448357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:39.448902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:39.450173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:39.460433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 832/1680] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:39.519950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:39.521493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:39.793275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 849/1681] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:39.794360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:39.794836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:39.794836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:39.867692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:39.872982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:39.909487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 833/1682] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:39.914270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:39.937241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d3ebd-816e-4a9b-b815-41e92576a248 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:39.959908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:39.961439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:39.963450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:39.964909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:39.965903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:39.968164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:39.974996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.012897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 850/1683] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:40.018185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:40.029076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1bb0c-46bb-4999-a11f-ef358aca7a48 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:40.061611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:40.067160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.067695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.068158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.072496 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:40.078939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.167548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 834/1684] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:40 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:40.171289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:40.190255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bb40e-e4a2-4cf6-aa6a-f648a89a6771 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:40.367154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:40.367709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.368632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.375213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.376085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:40.378063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.463404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 851/1685] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:40 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:40.466050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:40.489473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ed845-c389-4182-b0ae-63347bbd1349 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:40.504783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:40.505662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.506234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.506966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.512231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:40.514161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.550018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:40.550269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 835/1686] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:40.574568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ffba-5a07-45d2-adf1-2761005c320d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:40.585935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:40.586625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.586903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.587177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.587921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:40.589633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b05a1-84fa-4531-9f81-7c6ae7c98600 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.622312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 852/1687] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:40.623557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:40.664217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4c595-4a17-4144-a9c5-1e2a17b77f3f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:40.679750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:40.680794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.681077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.681349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] PATH_INFO: `/v3/projects/e147247ccbf5411a9779e0ea942c233f/users/efb080db9e9f466593ee3d5cbfc3c85c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.703503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:40.733278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e147247ccbf5411a9779e0ea942c233f, user_id=efb080db9e9f466593ee3d5cbfc3c85c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:40.747416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:40.780149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:40.780805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:40.781705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:40.783396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 836/1688] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:40 2022] PUT /identity/v3/projects/e147247ccbf5411a9779e0ea942c233f/users/efb080db9e9f466593ee3d5cbfc3c85c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:40.847670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] MFA Rules not processed for user `efb080db9e9f466593ee3d5cbfc3c85c`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:40.850754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:40.944595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:41.005662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:41.012630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:41.060195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 853/1689] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:41.068828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:41.070595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:41.147023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689ba18-a2eb-4d17-bad3-182e45d2d365 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:41.153211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:41.157478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:41.158675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:41.161366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] PATH_INFO: `/v3/projects/7e87a9892adc48e59b08bbbe7cb8217f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:41.162883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e87a9892adc48e59b08bbbe7cb8217f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:41.165952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: WARNING py.warnings [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 14:28:41.165952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: warnings.warn(msg) Jun 24 14:28:41.165952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: Jun 24 14:28:41.177086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:41.286816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4647-363f-4721-bd7c-64c34bd144ee None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:41.325792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e87a9892adc48e59b08bbbe7cb8217f', 'request_id': 'req-b8b4766a-4940-4f98-a1b5-69684caf6336'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:41.362799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e87a9892adc48e59b08bbbe7cb8217f', 'request_id': 'req-b8b4766a-4940-4f98-a1b5-69684caf6336'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:41.397687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e87a9892adc48e59b08bbbe7cb8217f', 'request_id': 'req-b8b4766a-4940-4f98-a1b5-69684caf6336'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:41.470270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:41.471632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:41.472748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:41.473300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:41.481749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] The token cache is being invalidate because project 7e87a9892adc48e59b08bbbe7cb8217f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:28:41.483089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:41.490639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b8b4766a-4940-4f98-a1b5-69684caf6336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:41.499460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 837/1690] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:28:41 2022] DELETE /identity/v3/projects/7e87a9892adc48e59b08bbbe7cb8217f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:41.506531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f819-bf85-41f1-96e7-749312712365 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:41.512113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f819-bf85-41f1-96e7-749312712365 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:41.512549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f819-bf85-41f1-96e7-749312712365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:41.621663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f647f819-bf85-41f1-96e7-749312712365 None None] MFA Rules not processed for user `9f8192ea4a174253afcebaf6f9d206c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:41.623189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f647f819-bf85-41f1-96e7-749312712365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:41.733910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:41.740800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268302b-3a14-4967-8dc1-7af15a02f1b4 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:41.776324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 854/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:41.784034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:41.785453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:41.786135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:41.792424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 855/1692] 10.222.0.13 () {54 vars in 912 bytes} [Fri Jun 24 14:28:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:41.793743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:41.803108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:41.863666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 838/1693] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:41.874328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:41.877172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:41.877569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:41.928342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:41.949321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:42.045539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270e7f-1c8e-4bd2-9449-0632d997e54d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:42.066016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:42.070390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:42.071958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:42.072893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:42.073176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:42.073457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] PATH_INFO: `/v3/users/e67ee2aa4dd54f5db6e005e64fee6662` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:42.081771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67ee2aa4dd54f5db6e005e64fee6662)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:42.083777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:42.194648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 839/1694] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:42.196582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:42.202237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:42.257901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67ee2aa4dd54f5db6e005e64fee6662'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:42.262739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67ee2aa4dd54f5db6e005e64fee6662'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:42.308261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67ee2aa4dd54f5db6e005e64fee6662'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:42.337851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67ee2aa4dd54f5db6e005e64fee6662'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:42.338492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67ee2aa4dd54f5db6e005e64fee6662'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:42.400331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 856/1695] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:41 2022] DELETE /identity/v3/users/e67ee2aa4dd54f5db6e005e64fee6662 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:42.400331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:42.409715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:42.432644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c089cd-5ee1-42a3-80e8-f4a04f3fcd3f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:42.611709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e0fb-7c58-41bf-9f01-435e349b6b69 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:42.633480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:42.634163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:42.634454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:42.641682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:42.647521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:42.664568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:42.665246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:42.665528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:42.665809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:42.681520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:42.681709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:42.681709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c290e-a5fc-46dd-b586-814a6907c627 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:42.686611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 857/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:42.816701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:42.869991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:42.876001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03f93b-f502-4249-a500-ca927e8fbe3a service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:42.918528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 840/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:43.599710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:43.600003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:43.600318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:43.651290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] MFA Rules not processed for user `3457e2d9157a451ba09567666d577154`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:43.652637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:43.794771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:43.802828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 858/1698] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:43.815954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ad78-93b6-41e2-8be6-6c86667e515e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:43.816621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ad78-93b6-41e2-8be6-6c86667e515e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:43.816621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9ad78-93b6-41e2-8be6-6c86667e515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:43.854260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-04d9ad78-93b6-41e2-8be6-6c86667e515e None None] MFA Rules not processed for user `3457e2d9157a451ba09567666d577154`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:43.861113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-04d9ad78-93b6-41e2-8be6-6c86667e515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:43.887801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 841/1699] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:43.926833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:43.929162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:43.959250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfeb58-8d0c-429c-979e-fac3d0e16afa None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:43.972351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:43.972351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:43.972351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:43.972351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:43.983586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:43.986183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:44.014612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 859/1700] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:44.393194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:44.393494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:44.393756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:44.459280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] MFA Rules not processed for user `32a564c2e69a44ec97fa6996b259bd68`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:44.462858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:44.492185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:44.493779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:44.723618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f6c0-0c2f-406f-a56c-cdd6ff74c835 service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:44.750178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 842/1701] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:44.757483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:44.767140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:44.767571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:44.767902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] PATH_INFO: `/v3/projects/729d0f924a8b4e13ab5e09903e9fa643` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:44.777451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729d0f924a8b4e13ab5e09903e9fa643)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:44.779838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:44.863427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:44.866921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:44.911008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729d0f924a8b4e13ab5e09903e9fa643', 'request_id': 'req-4d6f4509-ba01-49bf-ab7a-02114489d8a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:44.921089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729d0f924a8b4e13ab5e09903e9fa643', 'request_id': 'req-4d6f4509-ba01-49bf-ab7a-02114489d8a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:44.923386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7730-e9e6-41e9-8d38-453414bf9734 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:44.939552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729d0f924a8b4e13ab5e09903e9fa643', 'request_id': 'req-4d6f4509-ba01-49bf-ab7a-02114489d8a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:44.963800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] The token cache is being invalidate because project 729d0f924a8b4e13ab5e09903e9fa643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:28:44.964107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:44.965336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d6f4509-ba01-49bf-ab7a-02114489d8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:44.969178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 860/1702] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:28:44 2022] DELETE /identity/v3/projects/729d0f924a8b4e13ab5e09903e9fa643 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:44.985657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c03ed-ee78-4fe3-bee1-95f61bacf41f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:44.985937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c03ed-ee78-4fe3-bee1-95f61bacf41f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:44.986384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c03ed-ee78-4fe3-bee1-95f61bacf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.010947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e45c03ed-ee78-4fe3-bee1-95f61bacf41f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:45.012741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e45c03ed-ee78-4fe3-bee1-95f61bacf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.102040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 861/1703] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:45.105592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.105904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.106169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.109740 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:45.110669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.111108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.111228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 862/1704] 10.222.0.13 () {54 vars in 912 bytes} [Fri Jun 24 14:28:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:28:45.111641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.112320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:45.114537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.116080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.146904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:45.270155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:45.272597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eaea0-64ea-44f6-9e81-8c1e6308a69c service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:45.284103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:45.297499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 843/1705] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:45.300902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739321c-0a16-4155-9cfc-db0d7a35a961 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.301665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739321c-0a16-4155-9cfc-db0d7a35a961 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.302339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739321c-0a16-4155-9cfc-db0d7a35a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.315809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e75c6-d724-4f63-8be9-63a400e026d4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:45.330399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:45.331174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.340304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7739321c-0a16-4155-9cfc-db0d7a35a961 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:45.342152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7739321c-0a16-4155-9cfc-db0d7a35a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.351409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.353144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.356270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 844/1706] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:45.360104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.364749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.365327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.366278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.399583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:45.401627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.412149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:45.413918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:45.470160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 863/1707] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:45.496416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:45.567222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68260-f60f-4ea4-b820-1aab2b977443 service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:45.583759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:45.584699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.585080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.585447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.586369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:28:45.587700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:45.592616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:45.643355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 864/1708] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:28:45.648800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:45.653682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 845/1709] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:28:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:45.672236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f101b-9655-4dd6-a355-759db66502f4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:45.685212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:45.688401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.688824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.689345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.690292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:45.703826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:45.768499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:45.770461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:45.790250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 865/1710] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:45 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:45.794736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:45.801780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8eeab-1061-4957-9baf-a6bbef77352b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:45.927871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25110b-ed50-44ea-b305-f63936715ea5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:45.942623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:45.943409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:45.947678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:45.948007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:45.950844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:45.957763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:46.027985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 866/1711] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:45 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:28:46.033598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:46.091170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:46.091856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:46.092886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969ede-fe2d-4d65-b673-9db2584230a0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:46.095934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:46.099998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:46.123365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:46.125963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:46.126248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:46.132377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:46.133428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:46.135770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:46.136801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:46.150308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:46.163709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 846/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:46.223974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:46.245476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 867/1713] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:46.261556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d81-b79e-4ff6-add3-2d9c81b49af7 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:46.275064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:46.277184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:46.278574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:46.279039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:46.281749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:46.286159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095746cb-ffe6-4260-a37c-b97297479671 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:46.321162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 847/1714] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:28:46.325406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:46.341618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bf11a-b600-4581-b34d-f08f79558ae9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:46.362272 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:46.365504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:46.371133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:46.371564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] PATH_INFO: `/v3/projects/4014d02893b94131ad78b8c3e114619d/users/8f9d6efbbbaa41119cabfaef6e539955/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:46.436539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4014d02893b94131ad78b8c3e114619d, user_id=8f9d6efbbbaa41119cabfaef6e539955, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:46.449102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:46.498877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 868/1715] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:46 2022] PUT /identity/v3/projects/4014d02893b94131ad78b8c3e114619d/users/8f9d6efbbbaa41119cabfaef6e539955/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:46.509234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:46.509708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:46.510239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:46.591763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] MFA Rules not processed for user `8f9d6efbbbaa41119cabfaef6e539955`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:46.594782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:46.834960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 848/1716] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:46.836980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:46.886156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:46.989617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02914-5c0c-4582-baa0-64709647c056 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.004486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.005415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.007317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.007868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.009921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.018317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.091570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 869/1717] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:28:46 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:47.094791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:47.121382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aa10d-00ec-4112-bf62-64b70ef278a6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.154393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:47.310211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.310976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.311257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.311532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.312463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.315535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.365070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 849/1718] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:28:47 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:28:47.368792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:47.409008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a343d-4fd5-42ca-9bf2-f9467bf735ae admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.428244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.428831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.429112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.440840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.440840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.440840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.454033 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 870/1719] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:47.457206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:47.469005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365d16d-9cfb-4b54-bd6d-cc021a846ec1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.476710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.478068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.478350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.479209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] PATH_INFO: `/v3/projects/61054c5311df432aac90d3bcbd32d072/users/953d3fdabf164543ae6bd1bb83b283da/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.503453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61054c5311df432aac90d3bcbd32d072, user_id=953d3fdabf164543ae6bd1bb83b283da, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.508442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.536102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 850/1720] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:47 2022] PUT /identity/v3/projects/61054c5311df432aac90d3bcbd32d072/users/953d3fdabf164543ae6bd1bb83b283da/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:47.539774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:47.557036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1676-26d2-4c11-b5f7-beab0d8a339b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.786075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.790995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.791333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.791698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.792572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.800373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ec2c-6a27-4b10-94cd-00b6d7e87dcb admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.849930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:47.862650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255d3e-0f25-40a4-b2ce-294bd00ae30e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:47.865392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 871/1721] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:28:47.888813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:47.890905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.897178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.897687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] PATH_INFO: `/v3/projects/61054c5311df432aac90d3bcbd32d072/users/953d3fdabf164543ae6bd1bb83b283da/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:47.906354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61054c5311df432aac90d3bcbd32d072, user_id=953d3fdabf164543ae6bd1bb83b283da, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:47.910744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2d53d-042c-4b3b-b134-e5ec51ed0520 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:47.975440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 851/1722] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:28:47 2022] PUT /identity/v3/projects/61054c5311df432aac90d3bcbd32d072/users/953d3fdabf164543ae6bd1bb83b283da/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:28:47.992751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:47.993332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:47.993937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:48.067915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473190-b5dc-4868-b926-37a66864083b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:48.068259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473190-b5dc-4868-b926-37a66864083b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:48.068533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473190-b5dc-4868-b926-37a66864083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:48.081592 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] MFA Rules not processed for user `953d3fdabf164543ae6bd1bb83b283da`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:48.083751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:48.178309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-41473190-b5dc-4868-b926-37a66864083b None None] MFA Rules not processed for user `9f8192ea4a174253afcebaf6f9d206c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:48.187980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-41473190-b5dc-4868-b926-37a66864083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:48.367267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 872/1723] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:48.454697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:48.456415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:48.494525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:48.647214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891611a-bde8-4777-972e-394de6d199c9 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:48.657782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:48.659581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:48.660939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:48.661670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:48.712925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:48.714473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:48.767638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 873/1724] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:48.896255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 852/1725] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 829 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:48.972134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:48.974284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:49.028156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f7ce8-86ac-4200-9f09-28d12be40f9a service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:49.056225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:49.065121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:49.067569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:49.068210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:49.351236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:49.353064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00fdf-a4ff-4ca6-862d-c8022ed484a8 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:49.371536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 874/1726] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:49.800203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:49.800809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:49.801143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:49.834267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:49.835838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:50.150006 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 853/1727] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:28:50.480615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1013f5-6b98-4ed6-abc8-b9895420f91f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:50.482069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1013f5-6b98-4ed6-abc8-b9895420f91f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:50.482069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1013f5-6b98-4ed6-abc8-b9895420f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:50.533558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:50.535081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:50.550060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0e1013f5-6b98-4ed6-abc8-b9895420f91f None None] MFA Rules not processed for user `32a564c2e69a44ec97fa6996b259bd68`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:50.555673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0e1013f5-6b98-4ed6-abc8-b9895420f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:50.635116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:50.725966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37829048-5270-41c5-9c9b-f951fb440b48 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:50.739382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:50.740100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:50.740380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:50.740827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:50.769390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:50.771054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:50.772868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 875/1728] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:50.807605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 854/1729] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 14:28:53.179597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:53.180487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:53.180487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:53.245796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:53.255083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:53.507678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 876/1730] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 24 14:28:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:53.769747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:53.818887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e5cc-0b21-4ac1-aa3c-d5e68700691f service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:53.834205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:53.854291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:53.856096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:53.856978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:53.893150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:53.896451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea8309-3952-46c0-aa19-4b393a984580 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:53.944653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 855/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:28:56.198771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:56.201743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:56.261682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:56.471301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76c2a-730e-475f-9dda-00494d71407d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:56.491305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:56.500807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:56.501296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:56.501534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] PATH_INFO: `/v3/users/efb080db9e9f466593ee3d5cbfc3c85c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:56.511431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb080db9e9f466593ee3d5cbfc3c85c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:56.513466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:56.709124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb080db9e9f466593ee3d5cbfc3c85c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:56.711121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb080db9e9f466593ee3d5cbfc3c85c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:56.726513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb080db9e9f466593ee3d5cbfc3c85c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:56.751925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb080db9e9f466593ee3d5cbfc3c85c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:56.754278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb080db9e9f466593ee3d5cbfc3c85c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:56.790486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 877/1732] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:56 2022] DELETE /identity/v3/users/efb080db9e9f466593ee3d5cbfc3c85c => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:56.795357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:56.795888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:56.795980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:56.878971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:56.886169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:56.956926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:56.962238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:57.137546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 856/1733] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:57.206854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27a0b6-50a3-4b0d-b9ff-764caf0198ea admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:57.224405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:57.225603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:57.227738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:57.231307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] PATH_INFO: `/v3/users/aaebe04870304ad994a183c436806ae3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:57.239545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaebe04870304ad994a183c436806ae3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:57.247285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:57.338343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:57.399162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaebe04870304ad994a183c436806ae3'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:57.402561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaebe04870304ad994a183c436806ae3'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:57.455870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaebe04870304ad994a183c436806ae3'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:57.456457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:57.457943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:57.474575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaebe04870304ad994a183c436806ae3'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:57.475599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d8d13965-3098-46a8-b1cb-28fd2a65dae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaebe04870304ad994a183c436806ae3'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:28:57.557435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 878/1734] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:28:56 2022] DELETE /identity/v3/users/aaebe04870304ad994a183c436806ae3 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:28:57.564287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:57.565637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:57.566698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:57.650439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:28:57.656804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:57.697635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcabd-8f87-4e78-84c8-17434af3634e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:57.891149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:57.893214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:57.895902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:57.896404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:57.905202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:57.943603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 879/1735] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:28:57.959297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:57.961523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606190d1-6e0b-4ed3-b894-b4aa22ee6eb0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:57.985098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:28:58.005985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 857/1736] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:28:58.259239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:28:58.266900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:28:58.298683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba549-115b-4d38-952b-adf0e09a695b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:28:58.331219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:28:58.332652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:28:58.336501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:28:58.338015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:28:58.372880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:28:58.376233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:28:58.416115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 880/1737] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:00.544304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84441f-32bf-4671-b064-a75870788c6b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:00.544932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84441f-32bf-4671-b064-a75870788c6b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:00.544932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84441f-32bf-4671-b064-a75870788c6b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:00.547104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 858/1738] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:29:00.669417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:00.672226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:00.698765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d2bd-ab7b-46f0-bbac-2eff4b8e8e42 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:00.713664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:00.714620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:00.715060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:00.721080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:00.725393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:00.727749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:00.730228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] PATH_INFO: `/v3/users/8f9d6efbbbaa41119cabfaef6e539955` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:00.739483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9d6efbbbaa41119cabfaef6e539955)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:00.743532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:00.753860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:00.756843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:00.888646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9d6efbbbaa41119cabfaef6e539955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:00.891231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9d6efbbbaa41119cabfaef6e539955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:00.908774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9d6efbbbaa41119cabfaef6e539955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:00.922743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 859/1739] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:00.930931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9d6efbbbaa41119cabfaef6e539955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:00.937686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:00.938272 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a9651d01-a96f-4df1-b96a-ee0ce7421f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9d6efbbbaa41119cabfaef6e539955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:00.941382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:00.988320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 881/1740] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:00 2022] DELETE /identity/v3/users/8f9d6efbbbaa41119cabfaef6e539955 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:00.988413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539ffe-99c5-44b4-8639-3ef07da6be51 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:00.989340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:00.989634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:00.989991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:01.058895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:01.062949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:01.075154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:01.192780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:01.192780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:01.193229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:01.193229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] PATH_INFO: `/v3/projects/e147247ccbf5411a9779e0ea942c233f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:01.196273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e147247ccbf5411a9779e0ea942c233f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:01.201522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:01.301688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 882/1741] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:01.301688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:01.303151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:01.346222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e147247ccbf5411a9779e0ea942c233f', 'request_id': 'req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:01.364723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e147247ccbf5411a9779e0ea942c233f', 'request_id': 'req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:01.383665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e147247ccbf5411a9779e0ea942c233f', 'request_id': 'req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:01.423395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] The token cache is being invalidate because project e147247ccbf5411a9779e0ea942c233f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:01.423722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:01.426225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:01.430178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 860/1742] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:00 2022] DELETE /identity/v3/projects/e147247ccbf5411a9779e0ea942c233f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:01.430997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:01.437531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:01.528418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:01.662117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b5f6-b292-48e4-9c65-c60cd0c10a1d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:01.684518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:01.685194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:01.685477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:01.685799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:01.692931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:01.741157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8e01-92d0-4aa9-a55b-8e380e66a211 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:01.870172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:01.871671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9604c2-4d67-44ba-8917-4a150406e4e1 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:01.906157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 861/1743] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:01.907660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876a7-6760-4f30-a7f3-89bd986b71f1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:01.907948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876a7-6760-4f30-a7f3-89bd986b71f1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:01.908301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876a7-6760-4f30-a7f3-89bd986b71f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:01.984822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f7c876a7-6760-4f30-a7f3-89bd986b71f1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:01.984822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f7c876a7-6760-4f30-a7f3-89bd986b71f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:01.993777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 862/1744] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:02.003191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.003491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.005108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.006679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 863/1745] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:29:02.007247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.012679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.014430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:02.015582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.015902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.016166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.018971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.040111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:02.041966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c272f-50d0-4352-9d44-1c285d0c34bf service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:02.061579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb93e-17e5-4294-a1e4-a1208dca2287 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:02.064464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 883/1746] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:02.067957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e323-2e76-4b34-90de-f5ff7a7b0677 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.069021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e323-2e76-4b34-90de-f5ff7a7b0677 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.069214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e323-2e76-4b34-90de-f5ff7a7b0677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.075593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:02.077403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.077625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.077961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] PATH_INFO: `/v3/projects/2ca424feb1544cd6aaeae2b002853e52` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.079607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca424feb1544cd6aaeae2b002853e52)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:02.082163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:02.109856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ef41e323-2e76-4b34-90de-f5ff7a7b0677 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:02.111077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ef41e323-2e76-4b34-90de-f5ff7a7b0677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.141578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 884/1747] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:02.143410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.143713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.143997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.193855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:02.195239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.226460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 885/1748] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:02.229431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.260552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca424feb1544cd6aaeae2b002853e52', 'request_id': 'req-737340ad-1333-45cd-9c35-732f531c8801'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.263714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea65bf-1e45-488e-b8b6-5c651dde8dbb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:02.283413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:02.286206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca424feb1544cd6aaeae2b002853e52', 'request_id': 'req-737340ad-1333-45cd-9c35-732f531c8801'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.309195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca424feb1544cd6aaeae2b002853e52', 'request_id': 'req-737340ad-1333-45cd-9c35-732f531c8801'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.360041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] The token cache is being invalidate because project 2ca424feb1544cd6aaeae2b002853e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:02.360948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.362173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.365145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 864/1749] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:02 2022] DELETE /identity/v3/projects/2ca424feb1544cd6aaeae2b002853e52 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:02.368921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.407447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.443904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:02.445012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.445303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.447737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.451661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:02.452066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:02.460097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:02.513398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 886/1750] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:02.518935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.525962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.560911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe29dc-f81b-41de-b11d-63982eb65cc0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:02.570143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:02.572208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.573691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.574077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.576497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:02.578436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:02.581341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:02.618929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737340ad-1333-45cd-9c35-732f531c8801 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:02.633696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:02.634613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:02.634890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:02.635316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] PATH_INFO: `/v3/users/8b3d092268ab47cba7ca6114125302c4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:02.636683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3d092268ab47cba7ca6114125302c4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:02.638545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:02.672436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 887/1751] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:02 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:02.673442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.750319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3d092268ab47cba7ca6114125302c4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.794641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3d092268ab47cba7ca6114125302c4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.796848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3d092268ab47cba7ca6114125302c4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.798135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3d092268ab47cba7ca6114125302c4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.818684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3d092268ab47cba7ca6114125302c4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:02.855932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 865/1752] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:02 2022] DELETE /identity/v3/users/8b3d092268ab47cba7ca6114125302c4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:02.857446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:02.860144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:02.875742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082588-605b-4cd0-8cf2-5f3640c54192 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.032606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.033387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.033687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.033944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.034652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:03.036691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:03.038369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351b41-0b95-48eb-b0ad-96ad21ad6552 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.069392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.071279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.072457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.073777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.082748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:03.094113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 888/1753] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:02 2022] POST /identity/v3/users => generated 287 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:03.095158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:03.099596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:03.130502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14728ee-a84c-4059-9301-33c79fabc314 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.130660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:03.131062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:03.144596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.145064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.145348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.145625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.146373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:03.154513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:03.217018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 866/1754] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:03.233715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 889/1755] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:03.236012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:03.267169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c960-314b-411c-83c5-307bf9a35562 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.294975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.295701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.296036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.302882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.303747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:03.305688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae0c9-5199-4390-b3f3-754719cb56e4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:03.339406 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 867/1756] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:03.343884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:03.377544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1db0a-96d7-46e0-9aa7-a6b63da7fec2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.396006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.397178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.397768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.398054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] PATH_INFO: `/v3/projects/4e3a54366ab94ec493c5ac5e5d45a231/users/577681c5fa484ca99662793f2d138b5b/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.430097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3a54366ab94ec493c5ac5e5d45a231, user_id=577681c5fa484ca99662793f2d138b5b, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:03.433390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:03.436078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:03.491977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 890/1757] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:03 2022] PUT /identity/v3/projects/4e3a54366ab94ec493c5ac5e5d45a231/users/577681c5fa484ca99662793f2d138b5b/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:03.504346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.506229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.506229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:03.596308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] MFA Rules not processed for user `577681c5fa484ca99662793f2d138b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:03.597814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:03.692342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:03.783816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 868/1758] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:03.784577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:03.788413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:03.982112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3936c-16fe-420e-8f28-b8ad008b2e23 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:03.994922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:03.995815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:03.996119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:03.996464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] PATH_INFO: `/v3/projects/4014d02893b94131ad78b8c3e114619d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:04.000925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4014d02893b94131ad78b8c3e114619d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:04.002766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:04.116166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4014d02893b94131ad78b8c3e114619d', 'request_id': 'req-732213fa-e7f9-4d58-95c0-3043255ebb74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.137665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4014d02893b94131ad78b8c3e114619d', 'request_id': 'req-732213fa-e7f9-4d58-95c0-3043255ebb74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.143368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:04.151582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4014d02893b94131ad78b8c3e114619d', 'request_id': 'req-732213fa-e7f9-4d58-95c0-3043255ebb74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.172856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] The token cache is being invalidate because project 4014d02893b94131ad78b8c3e114619d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:04.173358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.175840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.178566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 891/1759] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:03 2022] DELETE /identity/v3/projects/4014d02893b94131ad78b8c3e114619d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:04.189873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:04.193175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:04.325138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5889b-321c-442e-a4a0-6f9114c47eaf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:04.374426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732213fa-e7f9-4d58-95c0-3043255ebb74 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:04.382136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:04.384218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:04.385919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:04.386711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] PATH_INFO: `/v3/users/953d3fdabf164543ae6bd1bb83b283da` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:04.392096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953d3fdabf164543ae6bd1bb83b283da)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:04.395265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:04.484099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:04.490583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:04.491876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:04.494901 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:04.495575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:04.499315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:04.569637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953d3fdabf164543ae6bd1bb83b283da'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.573441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953d3fdabf164543ae6bd1bb83b283da'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.614337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:04.621497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:04.625811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953d3fdabf164543ae6bd1bb83b283da'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.651915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 869/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:04.654418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:04.657252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953d3fdabf164543ae6bd1bb83b283da'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.659422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:04.660446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8a08ffef-7940-48ef-8767-7c5c70be2211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953d3fdabf164543ae6bd1bb83b283da'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.706202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e854-80c7-4703-b5c9-e635619e77e6 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:04.713456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 892/1761] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:04 2022] DELETE /identity/v3/users/953d3fdabf164543ae6bd1bb83b283da => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:04.719191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:04.725876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:04.728688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:04.730197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] PATH_INFO: `/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:04.733382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b7cb8dfc4a747cebb09b77c293980b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:04.737668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:04.740348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:04.825453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b7cb8dfc4a747cebb09b77c293980b3', 'request_id': 'req-3b9b3907-ed78-4a26-bcb5-49a62685eec5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.838586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b7cb8dfc4a747cebb09b77c293980b3', 'request_id': 'req-3b9b3907-ed78-4a26-bcb5-49a62685eec5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.859849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b7cb8dfc4a747cebb09b77c293980b3', 'request_id': 'req-3b9b3907-ed78-4a26-bcb5-49a62685eec5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.891294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] The token cache is being invalidate because project 6b7cb8dfc4a747cebb09b77c293980b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:04.891593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.895429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b9b3907-ed78-4a26-bcb5-49a62685eec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:04.897387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 870/1762] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:04 2022] DELETE /identity/v3/projects/6b7cb8dfc4a747cebb09b77c293980b3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:04.902925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:04.903214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:04.903731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:04.945545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:04.947083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:05.174358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 893/1763] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:05.182792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.183356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.183870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.248491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:05.252865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:05.291398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 871/1764] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:05.293097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.310100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3c92-2bf7-47d7-ae17-ef0185e7790c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.321638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.322632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.323062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.323471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.324506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:05.324943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.328428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.376607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 894/1765] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:05.380804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.395931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b95b6b-6a22-4030-b801-45c689cbb460 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.409270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.410658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.411521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.411521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.412182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.416598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.475449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 872/1766] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:05 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:05.479901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.496914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f498cd-1f27-48d3-afd2-fdf599bcee59 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.573075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.573808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.574140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.574418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.575109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.577836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.608566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 895/1767] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:05 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:05.609702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.621313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae570e7-a00f-4ee4-b7b4-24c393b6c7b9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.627175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.628160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.628543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.629119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.629894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.631636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.646466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 873/1768] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:05.647843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.659090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb058-22fc-40ba-b2fc-9fd65c1a5e7f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.666496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.667235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.667582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.667920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.669357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.671663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d1f0-fc85-421f-8aea-bb4b1397c333 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.686641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 896/1769] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:05.692455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.705030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a5a8-9293-4f44-8211-2140ffdbd9e0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.709718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.710607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.710917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.711556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] PATH_INFO: `/v3/projects/dfc1dd99771e414a853b7177d2db7578/users/f645be9de34b4c1495983bac03b8e855/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.728756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc1dd99771e414a853b7177d2db7578, user_id=f645be9de34b4c1495983bac03b8e855, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:05.730973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:05.753706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 874/1770] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:05 2022] PUT /identity/v3/projects/dfc1dd99771e414a853b7177d2db7578/users/f645be9de34b4c1495983bac03b8e855/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:05.764092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.764654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.766693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:05.788091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:05.803530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] MFA Rules not processed for user `f645be9de34b4c1495983bac03b8e855`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:05.807464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:05.885581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.888009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:05.911173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 897/1771] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:05.915564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:05.989850 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db7052-d2d7-45ba-9d16-8d841d5d1d35 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:05.996648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:05.998796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:05.999692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:05.999996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] PATH_INFO: `/v3/users/577681c5fa484ca99662793f2d138b5b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.001429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577681c5fa484ca99662793f2d138b5b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.003848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894314-068d-49c1-a3a3-8206baac0fce None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.004605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.009788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.010508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.010999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.011499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.012341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.015483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.043536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:06.049170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 898/1772] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:05 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:06.053195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.070486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577681c5fa484ca99662793f2d138b5b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.078988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577681c5fa484ca99662793f2d138b5b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.079776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577681c5fa484ca99662793f2d138b5b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.080489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577681c5fa484ca99662793f2d138b5b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.093952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577681c5fa484ca99662793f2d138b5b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.122147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 875/1773] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:05 2022] DELETE /identity/v3/users/577681c5fa484ca99662793f2d138b5b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:06.125220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.127689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.137916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254c98f-6f4c-484a-bd2d-bfce7ec8a4c6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.179768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:06.225294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248303c0-7c0f-40a4-9e68-7af1a3afbb39 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.230254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.230945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.231226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.231516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.232284 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.234513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e3e5-b00e-4ab9-9f2e-79fe9efeabb9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.236527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.237731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.238112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.238513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] PATH_INFO: `/v3/projects/61054c5311df432aac90d3bcbd32d072` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.240211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61054c5311df432aac90d3bcbd32d072)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.242323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.272011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 899/1774] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:06.272011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.272011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.272617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.296629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:06.300344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.320330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 900/1775] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:06.321627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.326458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.331411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61054c5311df432aac90d3bcbd32d072', 'request_id': 'req-b408fdf8-a157-4966-976d-55d08694bde7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.345772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61054c5311df432aac90d3bcbd32d072', 'request_id': 'req-b408fdf8-a157-4966-976d-55d08694bde7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.353241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f604fe-df1c-4417-bfec-38cf42cb9111 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.354678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61054c5311df432aac90d3bcbd32d072', 'request_id': 'req-b408fdf8-a157-4966-976d-55d08694bde7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.378055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] The token cache is being invalidate because project 61054c5311df432aac90d3bcbd32d072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:06.378460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.379386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:06.390410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 876/1776] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:06 2022] DELETE /identity/v3/projects/61054c5311df432aac90d3bcbd32d072 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:06.391563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.393050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.448432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:06.480032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.480740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.481021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.481296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.482199 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.485849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921201-4200-470e-976a-5390e3e6640b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.507549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 901/1777] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:06.510483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.510963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.511341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.536498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408fdf8-a157-4966-976d-55d08694bde7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.540616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.540787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:06.541267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.541545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.541821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.542360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.547540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.560271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 902/1778] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:06.560271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.560271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.573855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.575473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e980c-d386-46ea-a8d5-535cb4c195c1 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.586103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6adf-409e-40fa-ba6c-1c104033c89a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.589290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 877/1779] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:06.590827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.591291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.592321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.601549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.601549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.601869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.603834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] PATH_INFO: `/v3/projects/d346ea1ca4c141f48f9e981a3f476caa/users/e20a810fd03b494787018c994fa5530b/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.620503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:06.622080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:06.637424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d346ea1ca4c141f48f9e981a3f476caa, user_id=e20a810fd03b494787018c994fa5530b, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.642196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.643808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 878/1780] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:06.648518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.665908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300962-f64f-4c58-978c-b161e90f2c52 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.668742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 903/1781] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:06 2022] PUT /identity/v3/projects/d346ea1ca4c141f48f9e981a3f476caa/users/e20a810fd03b494787018c994fa5530b/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:06.672936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.807648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.808456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.808741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.809016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.809750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:06.814724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.819973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.840215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 879/1782] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:06.842260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.859066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea328-d646-4de0-b8a0-3c52741078ce admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.869199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.870322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.870698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.870989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.872084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.874837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.875389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344ef93-b786-4208-8b08-82de2a9f9d18 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.899619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:06.900589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:06.900908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:06.901185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:06.902335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:06.903931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:06.924220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 880/1783] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:06.928332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.928969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 904/1784] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:06.933438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:06.951381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44675c-808f-41ba-b641-be6c33b3ff63 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:06.966144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:07.050463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.051693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.052403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.052403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] PATH_INFO: `/v3/projects/d346ea1ca4c141f48f9e981a3f476caa/users/e20a810fd03b494787018c994fa5530b/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.055722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d346ea1ca4c141f48f9e981a3f476caa, user_id=e20a810fd03b494787018c994fa5530b, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.058780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f2e97-344d-4979-be0e-c5a41c37f034 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.084827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 905/1785] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:06 2022] PUT /identity/v3/projects/d346ea1ca4c141f48f9e981a3f476caa/users/e20a810fd03b494787018c994fa5530b/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:07.087623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.087918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.088259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.116860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e552b22-add8-4f5a-b1f2-11cbeaeb6e94 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.137845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] MFA Rules not processed for user `e20a810fd03b494787018c994fa5530b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:07.139442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.207364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:07.221822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.223056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.223056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.223757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.224258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.226464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.264204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 906/1786] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:07.267795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.279307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 881/1787] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:06 2022] POST /identity/v3/users => generated 282 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:07.281080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.282786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.283913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657e43e-6e9e-4627-b991-d56967b9bc6e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.289105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.289904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.290420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.291010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.291895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.293635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.301411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f9aa-e022-4fff-ac5d-bc8628209a9d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.306455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 907/1788] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:07.307376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.309438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.309576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.310348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.310835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.311039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] PATH_INFO: `/v3/projects/4e3a54366ab94ec493c5ac5e5d45a231` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.313562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3a54366ab94ec493c5ac5e5d45a231)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.315387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.372057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d275c16-b0c9-4583-88ac-9a28363dd2bd admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.373248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3a54366ab94ec493c5ac5e5d45a231', 'request_id': 'req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:07.381641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3a54366ab94ec493c5ac5e5d45a231', 'request_id': 'req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:07.387540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3a54366ab94ec493c5ac5e5d45a231', 'request_id': 'req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:07.399274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] The token cache is being invalidate because project 4e3a54366ab94ec493c5ac5e5d45a231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:07.399483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:07.400178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:07.401753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 882/1789] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:07 2022] DELETE /identity/v3/projects/4e3a54366ab94ec493c5ac5e5d45a231 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:07.405057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.406638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.418516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:07.435801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.437342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.437930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.438412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.443195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.517553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0bbd9-e0ac-43f6-a68e-188638b0adf9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.527778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.529603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.529882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.530181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.540629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.540826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.542288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42aa45-f881-426d-8f4f-d264b402418b service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.542608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.557219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 908/1790] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:07.559191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 883/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:07.563297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb077a4-3a72-45e2-ac40-18bb0b41a612 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.563583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb077a4-3a72-45e2-ac40-18bb0b41a612 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.563859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb077a4-3a72-45e2-ac40-18bb0b41a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.565568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.594204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1fb077a4-3a72-45e2-ac40-18bb0b41a612 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:07.595403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1fb077a4-3a72-45e2-ac40-18bb0b41a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.606024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f74ae7-3323-40bd-998e-159b03bd5c85 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.611300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 909/1792] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:07.613698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.614028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.614307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.625245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.626565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.626948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.628233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] PATH_INFO: `/v3/projects/db83fbca258c481da89f4395f415206a/users/653a1d390f4c4166838ff36805da3fe4/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.654547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db83fbca258c481da89f4395f415206a, user_id=653a1d390f4c4166838ff36805da3fe4, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.657940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b77d-0e21-4422-8e3b-e1404e85be2d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.674128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:07.676316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.691264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 884/1793] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:07 2022] PUT /identity/v3/projects/db83fbca258c481da89f4395f415206a/users/653a1d390f4c4166838ff36805da3fe4/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:07.701278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.701687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.702070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.739482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] MFA Rules not processed for user `653a1d390f4c4166838ff36805da3fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:07.740783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.771117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:07.773357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 910/1794] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:07.779084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.780662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.845099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 885/1795] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:07.846098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.862242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991c3f-dd34-4106-9083-eaeab1ec3d86 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.869188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.870622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.870986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.871206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffe6f3-b807-4ce5-9045-f2bca1fe995b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.871418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.872234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:07.872961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.875770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.876435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.877276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.877718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.878187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.880445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:07.890762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 886/1796] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:07.891669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.904664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7119063-d62b-4ca9-aaf5-afbb931d30ca admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:07.909711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:07.910434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:07.910782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:07.911222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:07.912005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.914018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.926289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:07.946319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 887/1797] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:07.947795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.947911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:07.949822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:07.962187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 911/1798] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:07.963104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:07.975049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb23ed-56da-4505-a1e7-0a28d1c5874a service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.026305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0be-f644-4eff-8ec5-a24a52a0b806 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.036631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.037462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.038005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.038605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.039518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.041828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.073969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.075051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.075541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 888/1799] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:08.076317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.081080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.081293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.081398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.083518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.112263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 912/1800] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:07 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:08.113289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.126097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e9be-b9ae-4167-a9a8-4e889a3044d6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.167072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f3f3-dcea-415d-8802-24e2aadf1601 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.174407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.175472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.175472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.175703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.176513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.178811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.209783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.212065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 889/1801] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:08.212218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.212878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.213289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.214876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.215644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.222547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.237262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:08.242281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 913/1802] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:08.246465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.246831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a03f-2176-428b-952f-f9e569a4197c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.262583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.263575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ddbd-6249-4cb9-bb1b-b08055cc77fe admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.263888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.264992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.265660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.266946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.269052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.271128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.272169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.272778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.273100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] PATH_INFO: `/v3/projects/385119e43ed3400a85f2dcf8b996df87/users/edea58dd566e42a0ab5c558d1568456a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.285581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 890/1803] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:08.289703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.295658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] RBAC: Authorizing `identity:create_grant(project_id=385119e43ed3400a85f2dcf8b996df87, user_id=edea58dd566e42a0ab5c558d1568456a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.299731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.306514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62345626-5603-45ad-b824-45d19d54e5f0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.313182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.314460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.315028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.315511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.316726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.317537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 914/1804] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:08 2022] PUT /identity/v3/projects/385119e43ed3400a85f2dcf8b996df87/users/edea58dd566e42a0ab5c558d1568456a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:08.319391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.322145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.335065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 891/1805] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:08.340569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.369568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee2a0-2a84-4e07-9df8-239cace7eb74 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.406095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:08.455457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ddf1-a8e6-46a5-b82d-9bce09c0519a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.471569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.472432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.472818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.473191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.474029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.480797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.508070 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 915/1806] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:08.511136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.525541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.526623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.526911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.527044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cae-b238-46a4-a198-385e39d90a39 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.527189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] PATH_INFO: `/v3/projects/672484c81f4f4d6592a446eded1c7722/users/7d5c6035cc8949c48e80522dddad16f8/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.533510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.534522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.534876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.535216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] PATH_INFO: `/v3/projects/385119e43ed3400a85f2dcf8b996df87/users/edea58dd566e42a0ab5c558d1568456a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.560202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385119e43ed3400a85f2dcf8b996df87, user_id=edea58dd566e42a0ab5c558d1568456a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.560202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3ff07-c033-4b5f-bf48-d7b8e050de21 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.565401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672484c81f4f4d6592a446eded1c7722, user_id=7d5c6035cc8949c48e80522dddad16f8, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.569786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94ef30-e28b-42ce-af27-dce4660de506 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.573089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 916/1807] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:08 2022] PUT /identity/v3/projects/385119e43ed3400a85f2dcf8b996df87/users/edea58dd566e42a0ab5c558d1568456a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:08.585467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.585768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.586073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.589631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 892/1808] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:08 2022] PUT /identity/v3/projects/672484c81f4f4d6592a446eded1c7722/users/7d5c6035cc8949c48e80522dddad16f8/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:08.602373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.602921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.603194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.620541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] MFA Rules not processed for user `edea58dd566e42a0ab5c558d1568456a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:08.621744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:08.632891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] MFA Rules not processed for user `7d5c6035cc8949c48e80522dddad16f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:08.634084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:08.695576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 917/1809] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:08.696588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.698121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:08.711952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 893/1810] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:08.712664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.768325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33e467-5cbe-45de-ba89-972fabc1eceb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.768547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351734d9-a19a-443f-9eb2-e96cc874156e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.771972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.772657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.772876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.773001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.773296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.773772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.774055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.774324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] PATH_INFO: `/v3/users/6117bb7bf42f4027b2d06d5ef3749acf` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.775639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6117bb7bf42f4027b2d06d5ef3749acf)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.777668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.784900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.786428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.790501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:08.798454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 894/1811] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:08.799250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.810145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb860a-9d03-4b48-ad22-65742ee3608a service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.817689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:08.818423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.818772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.819046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.819734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:08.821781 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:08.830365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6117bb7bf42f4027b2d06d5ef3749acf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:08.831068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6117bb7bf42f4027b2d06d5ef3749acf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:08.833175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:08.839316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6117bb7bf42f4027b2d06d5ef3749acf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:08.849550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6117bb7bf42f4027b2d06d5ef3749acf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:08.850228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddead55a-b69a-4be0-9e8b-279f42f13da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6117bb7bf42f4027b2d06d5ef3749acf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:08.855889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 895/1812] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:08.860992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.862665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:08.874650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 918/1813] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:08 2022] DELETE /identity/v3/users/6117bb7bf42f4027b2d06d5ef3749acf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:08.878429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:08.878720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:08.879279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:08.898350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:08.899566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:08.933248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d738b-fa65-4143-a8cc-f85c12edf37c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:08.962607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 919/1814] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:08.963378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:08.965244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.009498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.010182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.010466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.010756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.011439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.013517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.032965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5f65-1007-497d-9940-9420c1fd21f7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.036730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.037379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.037657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.037984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.038098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 896/1815] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:08 2022] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:09.038975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.040346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.044877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.114259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.115719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.125370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 920/1816] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:09.125649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4351d-5a89-4bc5-bbc0-ce89ef88a22b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.126730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.130011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.131033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.131592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.132920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.139010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2661e-bd2c-4937-9724-50c05b89fb66 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.144221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.145762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.146988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.147668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.147954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.148270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.149928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.151740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.157153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 897/1817] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:09.167022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 921/1818] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:09.168528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.178825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a0f8-83d5-43ac-856a-98882edb7039 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.192050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.193192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.193396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.193676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] PATH_INFO: `/v3/projects/d14c21a7e96d439197952f020c756b5d/users/594a9288248640cba1685845b2663b90/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.213261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:09.223559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14c21a7e96d439197952f020c756b5d, user_id=594a9288248640cba1685845b2663b90, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.228635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.251708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 898/1819] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:09 2022] PUT /identity/v3/projects/d14c21a7e96d439197952f020c756b5d/users/594a9288248640cba1685845b2663b90/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:09.253041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.265312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc974aed-6972-4ec0-9dda-f7f90c07c7d2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.278040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:09.354660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.355392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.355688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.355980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.356745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.359303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7f95-39ef-458a-8dff-add060a63039 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.369792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 922/1820] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:09.375276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.385941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332f21-070d-4f16-bffa-4f979dca5f41 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.398733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.399699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.400048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.400442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] PATH_INFO: `/v3/projects/d14c21a7e96d439197952f020c756b5d/users/594a9288248640cba1685845b2663b90/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.402980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14c21a7e96d439197952f020c756b5d, user_id=594a9288248640cba1685845b2663b90, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.406260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.418366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 899/1821] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:09 2022] PUT /identity/v3/projects/d14c21a7e96d439197952f020c756b5d/users/594a9288248640cba1685845b2663b90/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:09.430411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.430708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.430995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.457550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] MFA Rules not processed for user `594a9288248640cba1685845b2663b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:09.458753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.525147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.526951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.545079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 923/1822] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:09.566252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.570782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.662576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841819ea-00c8-437e-867d-46cc3e50559b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.664939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58214fcf-b76f-4d1b-ab50-1cb0a78b882a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.669289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.671358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.671500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.671703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] PATH_INFO: `/v3/projects/68acaba5663245e08dfbc28ce0f79de4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.672986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68acaba5663245e08dfbc28ce0f79de4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.675307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.685303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.685979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.686260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.686567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.703145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.704627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.732794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 924/1823] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:09.789165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68acaba5663245e08dfbc28ce0f79de4', 'request_id': 'req-43f3367d-4528-4dbe-bf25-a734adf8e998'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.799408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68acaba5663245e08dfbc28ce0f79de4', 'request_id': 'req-43f3367d-4528-4dbe-bf25-a734adf8e998'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.812259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68acaba5663245e08dfbc28ce0f79de4', 'request_id': 'req-43f3367d-4528-4dbe-bf25-a734adf8e998'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.838730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] The token cache is being invalidate because project 68acaba5663245e08dfbc28ce0f79de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:09.839050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.839890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.842003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 900/1824] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:09 2022] DELETE /identity/v3/projects/68acaba5663245e08dfbc28ce0f79de4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:09.846273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.865342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2ae-3b93-46b5-a898-230b143d56a6 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.865527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:09.866490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:09.904111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:09.932741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.933804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.934135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.934481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] PATH_INFO: `/v3/users/34c2caa2aafa4d04b65c29de5db8eb0a` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.935756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c2caa2aafa4d04b65c29de5db8eb0a)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.937823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.940303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3367d-4528-4dbe-bf25-a734adf8e998 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:09.944924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:09.945786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:09.946070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:09.946346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] PATH_INFO: `/v3/users/7d5c6035cc8949c48e80522dddad16f8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:09.947599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5c6035cc8949c48e80522dddad16f8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:09.949621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:09.961109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:09.989169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c2caa2aafa4d04b65c29de5db8eb0a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.990427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c2caa2aafa4d04b65c29de5db8eb0a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:09.998504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c2caa2aafa4d04b65c29de5db8eb0a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.003323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5c6035cc8949c48e80522dddad16f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.006486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c2caa2aafa4d04b65c29de5db8eb0a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.007160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3d571093-8bc7-4c7b-b545-ca57651f1506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c2caa2aafa4d04b65c29de5db8eb0a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.010544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5c6035cc8949c48e80522dddad16f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.011210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5c6035cc8949c48e80522dddad16f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.011835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5c6035cc8949c48e80522dddad16f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.019803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5c6035cc8949c48e80522dddad16f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.025915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 925/1825] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:09 2022] DELETE /identity/v3/users/34c2caa2aafa4d04b65c29de5db8eb0a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:10.037935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 901/1826] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:09 2022] DELETE /identity/v3/users/7d5c6035cc8949c48e80522dddad16f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:10.042640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.042937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.043218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.062751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:10.064222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.137919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 926/1827] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:10.146398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.147885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.249839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fcae7-9fa2-494d-a126-ad786e9a66ef admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.253951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.254905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.255411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.255812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.266403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.267926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734188cd-812b-42ba-ae36-31cd1e16441e service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.279183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 902/1828] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:10.311130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.313278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.334345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd48133-64ed-4e9f-8ac0-167b93c98511 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.358907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.359956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.360406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.360749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] PATH_INFO: `/v3/projects/9a6aaa2021d5417faf9d9359a96ee930` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.362156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6aaa2021d5417faf9d9359a96ee930)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.364251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.441404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6aaa2021d5417faf9d9359a96ee930', 'request_id': 'req-46ab1887-1732-4abd-b91e-c769851b098d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.442899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:10.455473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6aaa2021d5417faf9d9359a96ee930', 'request_id': 'req-46ab1887-1732-4abd-b91e-c769851b098d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.469428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6aaa2021d5417faf9d9359a96ee930', 'request_id': 'req-46ab1887-1732-4abd-b91e-c769851b098d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.487270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] The token cache is being invalidate because project 9a6aaa2021d5417faf9d9359a96ee930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:10.487774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.504152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-46ab1887-1732-4abd-b91e-c769851b098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.506885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 927/1829] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:10 2022] DELETE /identity/v3/projects/9a6aaa2021d5417faf9d9359a96ee930 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:10.511663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.512086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.512530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.530999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:10.532490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.615024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 903/1830] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:10.623076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.623409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.623864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.645659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:10.646996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.659367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 928/1831] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:10.659595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.660131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.661073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.669746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf350-ecb3-4142-8110-c57434dee52f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.676421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.677029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.677188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fee5a-df17-48be-9c46-7d489e615f2e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.677355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.677642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.679164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:10.679480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.681375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.682732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.688768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.689122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.689731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] PATH_INFO: `/v3/projects/672484c81f4f4d6592a446eded1c7722` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.693082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672484c81f4f4d6592a446eded1c7722)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.695156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.701935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 929/1832] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:29:10.706561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.717095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5d4d-c07e-4e4b-9dda-517d60072fb9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.723850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.724552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.724826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.725232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.725948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.728598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.731029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:10.753101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672484c81f4f4d6592a446eded1c7722', 'request_id': 'req-e1341eda-0222-45e6-b1a9-6d0a1223b263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.765680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672484c81f4f4d6592a446eded1c7722', 'request_id': 'req-e1341eda-0222-45e6-b1a9-6d0a1223b263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.776331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672484c81f4f4d6592a446eded1c7722', 'request_id': 'req-e1341eda-0222-45e6-b1a9-6d0a1223b263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.786075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 930/1833] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:10 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:10.790572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.796202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] The token cache is being invalidate because project 672484c81f4f4d6592a446eded1c7722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:10.796572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.797262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:10.802012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 904/1834] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:10 2022] DELETE /identity/v3/projects/672484c81f4f4d6592a446eded1c7722 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:10.805763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.807567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.911074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b79a8-788b-40ee-83a0-8d87c0d283a6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.935314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.936356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.936901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.937353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.938486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.940593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.947910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341eda-0222-45e6-b1a9-6d0a1223b263 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.954502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.955409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.956005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.956005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] PATH_INFO: `/v3/users/594a9288248640cba1685845b2663b90` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.957443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=594a9288248640cba1685845b2663b90)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.959386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:10.965710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 931/1835] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:10 2022] POST /identity/v3/users => generated 279 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:10.966673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:10.969171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:10.984152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bfed-7f28-4f29-8f14-d946cb25bacc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:10.989122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:10.990040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:10.990327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:10.990613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] PATH_INFO: `/v3/users/f645be9de34b4c1495983bac03b8e855` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:10.991868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f645be9de34b4c1495983bac03b8e855)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:10.994109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.030829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594a9288248640cba1685845b2663b90'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.038425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594a9288248640cba1685845b2663b90'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.039130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594a9288248640cba1685845b2663b90'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.039871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594a9288248640cba1685845b2663b90'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.045108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f645be9de34b4c1495983bac03b8e855'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.046569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f645be9de34b4c1495983bac03b8e855'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.049104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594a9288248640cba1685845b2663b90'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.053997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f645be9de34b4c1495983bac03b8e855'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.061831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f645be9de34b4c1495983bac03b8e855'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.062475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f8fbc1a5-fe7c-4002-9941-fe10234816b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f645be9de34b4c1495983bac03b8e855'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.068047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 905/1836] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:10 2022] DELETE /identity/v3/users/594a9288248640cba1685845b2663b90 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:11.071902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.073263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.077988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=13,keystone:SELECT=81,keystone:INSERT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:11.084917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 932/1837] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:10 2022] DELETE /identity/v3/users/f645be9de34b4c1495983bac03b8e855 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:11.091378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.091884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.093249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.112643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:11.113848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.124221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:11.163091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8d3a-f5bd-4fae-a03d-4c4860808c9a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.188154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 933/1838] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:11.197992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.199091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.241811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.242638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.243019 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.243573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.244713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.246680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.260135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 906/1839] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:11.262813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.265222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.271999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c238603-5bcd-4b1a-b1ad-f86da60c8d7f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.276213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.276862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.277147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.277419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.280248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366bc3d-63d7-4103-aac8-ddea204d28c5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.285284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.285925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.286254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.286613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.287706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.289071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.300944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.301089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 907/1840] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:11.302419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe23450-3ec3-47e8-b665-28744b9f9f99 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.305942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.318796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 934/1841] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:11.321614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f288da0-1f46-4499-929c-6a5f2b98cf27 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.327605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.328535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.328817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.329089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] PATH_INFO: `/v3/projects/d303da96e8ab414bb09075396cff1011/users/1ed74052464f4639bcef46e1a7515c01/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.347613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303da96e8ab414bb09075396cff1011, user_id=1ed74052464f4639bcef46e1a7515c01, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.351149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.370403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 908/1842] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:11 2022] PUT /identity/v3/projects/d303da96e8ab414bb09075396cff1011/users/1ed74052464f4639bcef46e1a7515c01/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:11.382356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.382651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.382934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.424103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] MFA Rules not processed for user `1ed74052464f4639bcef46e1a7515c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:11.425315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.441355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.443255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.537156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 935/1843] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:11.543494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.558200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ccfd3-0fe9-4ec2-9e9c-466c3a4d1137 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.559609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875cecf-0fb4-4ae6-9932-07d25818af6f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.565167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.565683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.566380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.566675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.566954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.567216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.567652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.567910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.568269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] PATH_INFO: `/v3/projects/d14c21a7e96d439197952f020c756b5d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.569706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14c21a7e96d439197952f020c756b5d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.570317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.572248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.608823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 936/1844] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:11 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:11.610278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.622012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:11.635104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:11.638151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14c21a7e96d439197952f020c756b5d', 'request_id': 'req-560f2f5a-7543-4385-a597-1491f715598a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.653455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14c21a7e96d439197952f020c756b5d', 'request_id': 'req-560f2f5a-7543-4385-a597-1491f715598a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.665819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14c21a7e96d439197952f020c756b5d', 'request_id': 'req-560f2f5a-7543-4385-a597-1491f715598a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.696487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] The token cache is being invalidate because project d14c21a7e96d439197952f020c756b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:11.696790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.697589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.699540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 909/1845] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:11 2022] DELETE /identity/v3/projects/d14c21a7e96d439197952f020c756b5d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:11.700552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.702536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.723961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4479-2283-4d36-98df-1d715eb71ba9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.787989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.788482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2f5a-7543-4385-a597-1491f715598a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.788828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.789122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.789401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.790110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.792077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d7e8-0431-476c-99ec-1c507a178845 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.793346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.794196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.794479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.794757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] PATH_INFO: `/v3/projects/dfc1dd99771e414a853b7177d2db7578` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.796074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc1dd99771e414a853b7177d2db7578)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.797988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.812350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 937/1846] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:11 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:11.813637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.813925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.814206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.836117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:11.837359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.852387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc1dd99771e414a853b7177d2db7578', 'request_id': 'req-00906cce-ac25-4b28-8199-6188f149ceae'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.864668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc1dd99771e414a853b7177d2db7578', 'request_id': 'req-00906cce-ac25-4b28-8199-6188f149ceae'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.872322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc1dd99771e414a853b7177d2db7578', 'request_id': 'req-00906cce-ac25-4b28-8199-6188f149ceae'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.887778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] The token cache is being invalidate because project dfc1dd99771e414a853b7177d2db7578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:11.888116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.889559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.894595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 910/1847] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:11 2022] DELETE /identity/v3/projects/dfc1dd99771e414a853b7177d2db7578 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:11.894595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.894595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.908815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 938/1848] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:11.909381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:11.910730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:11.923202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f87d2-6aa1-4021-af06-c86cf7855073 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:11.928277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:11.929274 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:11.929567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:11.929821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] PATH_INFO: `/v3/users/e20a810fd03b494787018c994fa5530b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:11.931083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20a810fd03b494787018c994fa5530b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:11.933087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:11.990848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:11.998642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20a810fd03b494787018c994fa5530b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:11.999944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20a810fd03b494787018c994fa5530b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.020117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20a810fd03b494787018c994fa5530b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.035143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00906cce-ac25-4b28-8199-6188f149ceae admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.037541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20a810fd03b494787018c994fa5530b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.038919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20a810fd03b494787018c994fa5530b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.045171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.046370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.051428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.051428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.051428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.052831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2785-95da-4a0b-900a-21f5323e2d19 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.060888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:12.080328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 911/1849] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:12.080328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.080328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.080328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.096146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 939/1850] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:11 2022] DELETE /identity/v3/users/e20a810fd03b494787018c994fa5530b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:12.097334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.099901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.115248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:12.118263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.187581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83a449-407d-461d-8eda-f80f65197326 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.198682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.199593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.199876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.200195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] PATH_INFO: `/v3/projects/c9229da7906a48cdbc5a81daf7599df0/users/61c4587a55024f3d9070235f5c3d8060/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.233840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9229da7906a48cdbc5a81daf7599df0, user_id=61c4587a55024f3d9070235f5c3d8060, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.237504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.269128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 940/1851] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:12 2022] PUT /identity/v3/projects/c9229da7906a48cdbc5a81daf7599df0/users/61c4587a55024f3d9070235f5c3d8060/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:12.270097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.280735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.302664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 912/1852] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:12.304261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.320733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e1bb-61b7-44ba-a2a4-59af555b5963 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.356714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3142f-95a5-467e-9a08-a5edf4b6db6c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.363589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.365394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.365682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.365962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] PATH_INFO: `/v3/users/653a1d390f4c4166838ff36805da3fe4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.367338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=653a1d390f4c4166838ff36805da3fe4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.369700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.404367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.414836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.414836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.414836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.414836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.414836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.418996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 913/1853] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:12.419694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.431189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a8d0-ddd9-46ae-91c6-e54df1cb3624 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.436408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.437085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.437426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.437755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.438539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:12.438872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.440656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.455706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:12.457492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 914/1854] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:12.458361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.463562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653a1d390f4c4166838ff36805da3fe4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.464399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653a1d390f4c4166838ff36805da3fe4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.472888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c11b9-90a8-4f60-b06d-26904f785022 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.476011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653a1d390f4c4166838ff36805da3fe4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.480519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.481848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.482097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.482456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] PATH_INFO: `/v3/projects/c9229da7906a48cdbc5a81daf7599df0/users/61c4587a55024f3d9070235f5c3d8060/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.485847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9229da7906a48cdbc5a81daf7599df0, user_id=61c4587a55024f3d9070235f5c3d8060, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.486265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653a1d390f4c4166838ff36805da3fe4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.487142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-744a8089-b698-4275-a0f1-28409990e14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653a1d390f4c4166838ff36805da3fe4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:12.489183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.500863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 915/1855] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:12 2022] PUT /identity/v3/projects/c9229da7906a48cdbc5a81daf7599df0/users/61c4587a55024f3d9070235f5c3d8060/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:12.508244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 941/1856] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:12 2022] DELETE /identity/v3/users/653a1d390f4c4166838ff36805da3fe4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:12.509138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.511090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.513996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29fc2-e715-43b3-8a51-5fcd952cd609 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.514289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29fc2-e715-43b3-8a51-5fcd952cd609 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.514762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29fc2-e715-43b3-8a51-5fcd952cd609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.565531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-70a29fc2-e715-43b3-8a51-5fcd952cd609 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:12.566931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-70a29fc2-e715-43b3-8a51-5fcd952cd609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.622578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1323b-b383-48cd-8fa5-2610ab315754 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.636694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:12.648404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 942/1857] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:12.649820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.650116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.650396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.685236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] MFA Rules not processed for user `61c4587a55024f3d9070235f5c3d8060`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:12.687328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.693978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.694922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.695309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.695684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.696517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.699251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.753276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 916/1858] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:12 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:12.754196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.755984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.781372 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 943/1859] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:12.782465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.783933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:12.812388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037d8dd-8171-4c97-918a-b1fb5b265f89 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.827099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6222-de73-4c0e-b233-e3f75768279c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:12.832591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.834429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.834784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.835132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.910479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:12.940693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:12.941571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:12.942146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:12.942260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] PATH_INFO: `/v3/projects/d346ea1ca4c141f48f9e981a3f476caa` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:12.944117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d346ea1ca4c141f48f9e981a3f476caa)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.949542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.970332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:12.972493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:12.984430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 917/1860] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:12.985837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:12.996700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920414cf-cfe3-46b0-853a-21c484376782 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.010035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd346ea1ca4c141f48f9e981a3f476caa', 'request_id': 'req-267d6acc-ad3c-4268-b490-311d08c63199'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.018326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd346ea1ca4c141f48f9e981a3f476caa', 'request_id': 'req-267d6acc-ad3c-4268-b490-311d08c63199'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.029887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd346ea1ca4c141f48f9e981a3f476caa', 'request_id': 'req-267d6acc-ad3c-4268-b490-311d08c63199'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.046300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] The token cache is being invalidate because project d346ea1ca4c141f48f9e981a3f476caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:13.046957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.047924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.050870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 944/1861] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:12 2022] DELETE /identity/v3/projects/d346ea1ca4c141f48f9e981a3f476caa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:13.052324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.054005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.061145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:13.084972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.085969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.086434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.086702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.088457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.093880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03df7e-9495-4b5a-b7b9-3659601851bc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.128505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 918/1862] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:12 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:13.129520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.129789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.130068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.131181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d6acc-ad3c-4268-b490-311d08c63199 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.135247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.135957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.136341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.136683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.140679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.151363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:13.152692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.162485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 919/1863] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:13.163342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.164721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.177306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ab32-36a6-4f7f-966c-b11bc2ba515e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.183864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.184563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.184847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.185123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.186001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.188252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380213d-30ae-47d8-aba3-3411681ad313 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.201267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 920/1864] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:13.203509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.203995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.204498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.226038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:13.228275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.238658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 921/1865] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:13.243660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.254596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065cde1-ba07-4bf5-8707-b1a308c8980c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.260504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.261516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.261865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.262227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.263044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.264860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.282948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 922/1866] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:13.282948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.293407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c2c3d-39c2-4b16-bd12-a59c6f07507b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.299555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.300359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.300707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.301323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.302070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:13.302492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.304566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.323985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 923/1867] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:13.324855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.338859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37cbb-c968-42ac-b70c-899e4f6301d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.345198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.346163 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.346517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.347008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] PATH_INFO: `/v3/projects/861dec20910e445ca7fd769954b233ab/users/91cb9163d6f441d58827fa9cfe239db4/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.366267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861dec20910e445ca7fd769954b233ab, user_id=91cb9163d6f441d58827fa9cfe239db4, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.367451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.369059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.369195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.380891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 945/1868] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:13.394567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.401537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 924/1869] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:13 2022] PUT /identity/v3/projects/861dec20910e445ca7fd769954b233ab/users/91cb9163d6f441d58827fa9cfe239db4/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:13.405754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.407704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.419747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949528af-a454-4c69-9971-f9082bc73238 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.462445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:13.511888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.512613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.512897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.513167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.513874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.518134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d3d91-665c-4e4e-a363-781da415d65a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.527281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7329c1-a66d-43e8-bde1-82fd925333d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.538395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.539410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.540060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.540060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] PATH_INFO: `/v3/projects/db83fbca258c481da89f4395f415206a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.541390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db83fbca258c481da89f4395f415206a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.543403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.563386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 946/1870] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:13.563386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.563386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.563386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.597279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] MFA Rules not processed for user `91cb9163d6f441d58827fa9cfe239db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:13.598451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.612255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db83fbca258c481da89f4395f415206a', 'request_id': 'req-de90baf8-4552-4ab4-aed1-a1e74088abdf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.621571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db83fbca258c481da89f4395f415206a', 'request_id': 'req-de90baf8-4552-4ab4-aed1-a1e74088abdf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.629340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db83fbca258c481da89f4395f415206a', 'request_id': 'req-de90baf8-4552-4ab4-aed1-a1e74088abdf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.637109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:13.642072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] The token cache is being invalidate because project db83fbca258c481da89f4395f415206a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:13.642813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.643673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.645495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 925/1871] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:13 2022] DELETE /identity/v3/projects/db83fbca258c481da89f4395f415206a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:13.646680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.648926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.669482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 947/1872] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:13.670359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.672246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.710650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90baf8-4552-4ab4-aed1-a1e74088abdf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.714379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.715045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.715329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.715605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.717982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.737868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d89fc-4646-44a4-a6e5-20b23d2c5f73 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.742732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.743385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.743659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.743935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.744644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.746547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.766976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 948/1873] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:13.767795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.769373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.781955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.782587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cd8a-c169-481f-ad23-b804f69afc22 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.783414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.787315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.788202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.788485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.788758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] PATH_INFO: `/v3/users/edea58dd566e42a0ab5c558d1568456a` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.789981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edea58dd566e42a0ab5c558d1568456a)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.791906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.792803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 926/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:13.793571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.795012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:13.808691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24449-73cf-4b47-a0a8-dea7a17884d0 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:13.815016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:13.815676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:13.815994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:13.816388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:13.817075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:13.818975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:13.824589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:13.852793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edea58dd566e42a0ab5c558d1568456a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.853697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edea58dd566e42a0ab5c558d1568456a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.856641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 927/1875] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:13.857876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.863012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edea58dd566e42a0ab5c558d1568456a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.872619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edea58dd566e42a0ab5c558d1568456a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.874994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edea58dd566e42a0ab5c558d1568456a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:13.900712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 949/1876] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:13 2022] DELETE /identity/v3/users/edea58dd566e42a0ab5c558d1568456a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:13.901582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:13.904092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.004415 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9af29-ed57-4cb3-a11b-dbdda5eaf9dd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.069663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:14.075148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedca3-1b7a-4207-a215-42db6da8389c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.084832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.085650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.086050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.086326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.087079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.089253 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.117969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.118805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.119097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.119681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.120606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.122400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.125068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 950/1877] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:13 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:14.130381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.134231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 928/1878] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:14.137834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.140432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.146717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb324-d751-4b4f-8101-117a02641e28 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.151960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.152658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.152936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.153488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.154218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.156475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.173690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345b82-c12d-4322-9bda-ccbe3d732605 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.173908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 951/1879] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:14.175510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.186886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.187646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.188148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb729f-e86b-4936-ba1a-376afc47cdfe admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.188634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.189728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.190623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.193493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.197248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.198365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.198824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.199884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] PATH_INFO: `/v3/projects/d7e360047fde42b29b6117ee869882fe/users/ceee820877414cd89f8a2d64cd69d080/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.222188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 929/1880] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:14.223938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.234363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e360047fde42b29b6117ee869882fe, user_id=ceee820877414cd89f8a2d64cd69d080, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.242946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.249068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81ec2-aef0-468a-8f72-94b2fe406dd4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.257750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.258849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.259147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.259408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] PATH_INFO: `/v3/projects/0fd09718a5094f0dab013b14ae27a54d/users/42bdc20b93ac4047b779e11c8cf91a10/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.270268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 952/1881] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:14 2022] PUT /identity/v3/projects/d7e360047fde42b29b6117ee869882fe/users/ceee820877414cd89f8a2d64cd69d080/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:14.281614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.297815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd09718a5094f0dab013b14ae27a54d, user_id=42bdc20b93ac4047b779e11c8cf91a10, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.300794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ab92-1b82-4ba6-934d-fc90cfd6809c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.319384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 930/1882] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:14 2022] PUT /identity/v3/projects/0fd09718a5094f0dab013b14ae27a54d/users/42bdc20b93ac4047b779e11c8cf91a10/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:14.331202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.331528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.331814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.365836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] MFA Rules not processed for user `42bdc20b93ac4047b779e11c8cf91a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:14.367076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.371783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:14.376710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a3d6-3462-4ca8-9819-97a8db678212 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.466571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.467336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.468472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.468812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.470373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.471563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 931/1883] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:14.472544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.473966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.476457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.490523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 953/1884] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:14.491367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.493905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798772d-76f4-41af-8067-f53ec8fa81c1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.498734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.499589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.499869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.500188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] PATH_INFO: `/v3/projects/385119e43ed3400a85f2dcf8b996df87` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.501588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385119e43ed3400a85f2dcf8b996df87)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.501915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55cb7a-4f34-4c05-8a92-4142426d49c3 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.503671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.506652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.507293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.507606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.507842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.508577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.510482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.544822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 954/1885] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:14.544822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.585800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385119e43ed3400a85f2dcf8b996df87', 'request_id': 'req-e6a73292-a389-4b96-9ede-238e53963b64'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:14.598610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385119e43ed3400a85f2dcf8b996df87', 'request_id': 'req-e6a73292-a389-4b96-9ede-238e53963b64'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:14.609384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385119e43ed3400a85f2dcf8b996df87', 'request_id': 'req-e6a73292-a389-4b96-9ede-238e53963b64'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:14.628066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] The token cache is being invalidate because project 385119e43ed3400a85f2dcf8b996df87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:14.628505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:14.629213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6a73292-a389-4b96-9ede-238e53963b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:14.630883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 932/1886] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:14 2022] DELETE /identity/v3/projects/385119e43ed3400a85f2dcf8b996df87 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:14.632053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.632323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.632596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.634757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 933/1887] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:29:14.634757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.636165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.657339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310815cf-5fe7-4ed8-9e20-b74988541d48 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.659948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:14.732076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4883-6cd7-4e90-a5a4-e11ba7b96b88 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.736977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.737627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.737912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.738189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.738893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.740874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2bf1-71d5-4e44-a1f0-ae7ec08d6bc6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.756336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.756336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.756336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.756336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] PATH_INFO: `/v3/projects/d7e360047fde42b29b6117ee869882fe/users/ceee820877414cd89f8a2d64cd69d080/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.756765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e360047fde42b29b6117ee869882fe, user_id=ceee820877414cd89f8a2d64cd69d080, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.756765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28fd34-2c9f-4638-9d94-2de70cb73c36 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.767780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 934/1888] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:14.769293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.769587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.769908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.779504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 955/1889] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:14 2022] PUT /identity/v3/projects/d7e360047fde42b29b6117ee869882fe/users/ceee820877414cd89f8a2d64cd69d080/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:14.779504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801576bd-79b4-4e60-a0c8-699573aae321 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.779504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801576bd-79b4-4e60-a0c8-699573aae321 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.779504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801576bd-79b4-4e60-a0c8-699573aae321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.795328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-801576bd-79b4-4e60-a0c8-699573aae321 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:14.796604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-801576bd-79b4-4e60-a0c8-699573aae321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.796742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:14.797885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.810461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:14.863344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 935/1890] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:14.864229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.875305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9563c3e-dedd-4823-b587-66c0567c6ae6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.879963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.880675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.880952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.881221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.881942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.883540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08eef9-37c6-485e-aae9-b39a094621da admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.897692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 936/1891] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:14.897987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 956/1892] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:14.897987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.897987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.897987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.898259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ff46-91cd-4312-980b-37298f58882d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.898259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ff46-91cd-4312-980b-37298f58882d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.898259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ff46-91cd-4312-980b-37298f58882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.918001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:14.919214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.927991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b178ff46-91cd-4312-980b-37298f58882d None None] MFA Rules not processed for user `ceee820877414cd89f8a2d64cd69d080`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:14.928578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 957/1893] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:14.929482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.930464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b178ff46-91cd-4312-980b-37298f58882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:14.940567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cea476-aeaf-4433-a3df-e52acc375d13 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:14.945216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:14.946110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:14.946389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:14.946662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] PATH_INFO: `/v3/projects/54184a22673941b992b92e74bb0bc2da/users/2c8f7815da64482ba102b1708ea79d89/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:14.962064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54184a22673941b992b92e74bb0bc2da, user_id=2c8f7815da64482ba102b1708ea79d89, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:14.964781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:14.980945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 958/1894] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:14 2022] PUT /identity/v3/projects/54184a22673941b992b92e74bb0bc2da/users/2c8f7815da64482ba102b1708ea79d89/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:14.982170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:14.984525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.014186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 937/1895] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:15.015402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ff46-91cd-4312-980b-37298f58882d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.027147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ff46-91cd-4312-980b-37298f58882d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.039855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:15.066307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154687a-e65f-42cd-869b-69785974dc8a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.071922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.072603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.072883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.073161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.087716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.089493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.097182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.097862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.098202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.098517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.099287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:15.100600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.101339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.103492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 959/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:15.104506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.119545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec2119-eb81-4709-9cac-f6e04014083c service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.130111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.130834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.131460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.131460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.132129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.137848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 938/1897] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:15.138706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.138817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.143862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.154482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 960/1898] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:15.157074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.169197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8dff1-5dad-4ebb-a017-2f0d12e5204f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.175124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.175757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.176169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.180209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.180209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.180426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.212359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 961/1899] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:15 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:15.213267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.238357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93c95-7ed7-40c6-bc5c-3c88ddf2fc00 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.270072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:15.313972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.315636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.316240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.317260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.328536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21906d7-8f66-44ae-8c3a-c211f920345b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.335362 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.339928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.345015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.345407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] PATH_INFO: `/v3/projects/54184a22673941b992b92e74bb0bc2da/users/2c8f7815da64482ba102b1708ea79d89/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.348265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] RBAC: Authorizing `identity:create_grant(project_id=54184a22673941b992b92e74bb0bc2da, user_id=2c8f7815da64482ba102b1708ea79d89, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.351290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.369686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 962/1900] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:15 2022] PUT /identity/v3/projects/54184a22673941b992b92e74bb0bc2da/users/2c8f7815da64482ba102b1708ea79d89/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:15.381167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.448004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.449665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93322a3-90ff-4cd3-96d8-4a207a2579c4 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.461802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 939/1901] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:15.463033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.463319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.463591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.474446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc0b5-65ed-4b21-9ad8-a50b256547de admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.495774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.495774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.495774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.495774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.496226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.496518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.535060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 963/1902] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:15 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:15.535233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] MFA Rules not processed for user `2c8f7815da64482ba102b1708ea79d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:15.536660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.539124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.541399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:15.564292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44354c-d61a-41c7-bfdb-430d07a75fa4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.578625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.579417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.579705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.579983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.580816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.582513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.596118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 964/1903] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:15.596118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.599168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.614769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a324-515c-40ed-aacb-98e80ce443e0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.621793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.622679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.622960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.623233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] PATH_INFO: `/v3/users/91cb9163d6f441d58827fa9cfe239db4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.625054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cb9163d6f441d58827fa9cfe239db4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.627757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.648256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 940/1904] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:15.649698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.664964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c99dee-130f-4392-968c-42d19f4b4b61 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.671438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.672155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.672438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.672715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.673451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.675081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.686478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 941/1905] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:15.687794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cb9163d6f441d58827fa9cfe239db4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:15.689017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cb9163d6f441d58827fa9cfe239db4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:15.691039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.697913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cb9163d6f441d58827fa9cfe239db4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:15.710171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cb9163d6f441d58827fa9cfe239db4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:15.711365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cb9163d6f441d58827fa9cfe239db4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:15.736379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 965/1906] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:15 2022] DELETE /identity/v3/users/91cb9163d6f441d58827fa9cfe239db4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:15.737280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:15.740244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.754887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212445dc-e923-4e92-aaf7-398849db7e98 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.767687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:15.816819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.817890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.817890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.818142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.820761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.836993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc6b8a-36f5-4d16-acae-cf8fca81d976 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:15.843063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:15.844144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.844429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.845276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] PATH_INFO: `/v3/projects/ef7b964c09624f27999c9d924a41e243/users/e2b43223a013415ab8a481cc7392ee46/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.866666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7b964c09624f27999c9d924a41e243, user_id=e2b43223a013415ab8a481cc7392ee46, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.870101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f9961-a33a-4b50-852b-c45cc55da072 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.898812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 966/1907] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:15 2022] PUT /identity/v3/projects/ef7b964c09624f27999c9d924a41e243/users/e2b43223a013415ab8a481cc7392ee46/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:15.900791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.901085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.901422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:15.919843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:15.925007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:15.926301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fed5-7cd6-47a4-b780-373bacf0afdc service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:15.940221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:15.941453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:15.953802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 942/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:15.962083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:15.962982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:15.963408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.005968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 967/1909] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:16.030673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] MFA Rules not processed for user `e2b43223a013415ab8a481cc7392ee46`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:16.032001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:16.086437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.087894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:16.109633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 943/1910] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:16.114194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.126387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71984767-0cb0-4e02-b4a9-ed04f2160d04 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.140956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.141642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.141928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.142208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.143004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.149536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.238205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 944/1911] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:16 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:16.239864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.324815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14e3bc-1ee0-42da-b242-1a3a3528f737 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.438241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce63a2-d4c1-4713-a90c-87812e99001f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.465754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.466972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.467495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.468444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.469489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.469612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.470309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.471158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.471158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.474141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.489704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.492170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.508785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:16.513759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 945/1912] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:16 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:16.516399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.522261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 968/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:16.549906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e562f-8855-4788-886f-31bf5475b35c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.561843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.563770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.564087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.564373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.566338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.572201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.600630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 946/1914] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:16.605825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.617699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1661e-4a53-469c-87fe-cf5e6825eb13 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.622935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.624684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.625020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.625312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] PATH_INFO: `/v3/projects/404bdd7715a840f9b411acb9b0b34f3d/users/11959cc567a34888a6804bb540aef35c/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.641780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.643469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404bdd7715a840f9b411acb9b0b34f3d, user_id=11959cc567a34888a6804bb540aef35c, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.643814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:16.647036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.667743 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b40-d5bc-4191-a820-444595f17fbc admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.672856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 969/1915] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:16 2022] PUT /identity/v3/projects/404bdd7715a840f9b411acb9b0b34f3d/users/11959cc567a34888a6804bb540aef35c/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:16.674245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.742565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:16.779677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37c1-20ed-4389-8667-7a27ef8ea124 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.789481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.790534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.790819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.791304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.792251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.794122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.802215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.803888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.804637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.805085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] PATH_INFO: `/v3/users/42bdc20b93ac4047b779e11c8cf91a10` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.806799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bdc20b93ac4047b779e11c8cf91a10)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.809568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.809899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 970/1916] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:16.810785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:16.826704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd086-913b-48d2-a741-ba63353e9978 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:16.840802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:16.841906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.842972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.843415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] PATH_INFO: `/v3/projects/404bdd7715a840f9b411acb9b0b34f3d/users/11959cc567a34888a6804bb540aef35c/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.849150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404bdd7715a840f9b411acb9b0b34f3d, user_id=11959cc567a34888a6804bb540aef35c, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:16.853072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10839-f878-4921-a3ef-4e0e07e4a1f5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:16.872010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 971/1917] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:16 2022] PUT /identity/v3/projects/404bdd7715a840f9b411acb9b0b34f3d/users/11959cc567a34888a6804bb540aef35c/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:16.886542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:16.887683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:16.888128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:16.913760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bdc20b93ac4047b779e11c8cf91a10'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:16.926564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] MFA Rules not processed for user `11959cc567a34888a6804bb540aef35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:16.927879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bdc20b93ac4047b779e11c8cf91a10'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:16.928242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:16.929408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bdc20b93ac4047b779e11c8cf91a10'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:16.934276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bdc20b93ac4047b779e11c8cf91a10'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:16.951549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4abe277b-d3ef-412d-868d-ee3a477c4081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bdc20b93ac4047b779e11c8cf91a10'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:16.994628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 947/1918] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:16 2022] DELETE /identity/v3/users/42bdc20b93ac4047b779e11c8cf91a10 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:16.999758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:17.000165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:17.000519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:17.040364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:17.041612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.093837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 972/1919] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:17.105939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:17.107573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.188110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 948/1920] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:17.189061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:17.195765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.217631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f571-b53e-481d-a8d6-ad0958fe3c29 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:17.240236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:17.241427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:17.241861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:17.242300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] PATH_INFO: `/v3/projects/861dec20910e445ca7fd769954b233ab` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:17.243953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861dec20910e445ca7fd769954b233ab)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:17.245897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:17.247224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:17.284649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8228-a945-4c0a-8707-4ac7fec974cc None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:17.331751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861dec20910e445ca7fd769954b233ab', 'request_id': 'req-4c7b80a5-2c99-41e1-b341-bb50267d8c21'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.340099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861dec20910e445ca7fd769954b233ab', 'request_id': 'req-4c7b80a5-2c99-41e1-b341-bb50267d8c21'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.341612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:17.348839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861dec20910e445ca7fd769954b233ab', 'request_id': 'req-4c7b80a5-2c99-41e1-b341-bb50267d8c21'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.352310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:17.353553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:17.354121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:17.354351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:17.356245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.364136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] The token cache is being invalidate because project 861dec20910e445ca7fd769954b233ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:17.364427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.365945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.367763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 949/1921] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:17 2022] DELETE /identity/v3/projects/861dec20910e445ca7fd769954b233ab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:17.368459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:17.369749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.424914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:17.426060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:17.435687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b80a5-2c99-41e1-b341-bb50267d8c21 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:17.436462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 973/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:17.437117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:17.441623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:17.442421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:17.442744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:17.442975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:17.445015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:17.448626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04cf93-4eba-412b-b142-9210d774a92e service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:17.523315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:17.524839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:17.525122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:17.525399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] PATH_INFO: `/v3/users/ceee820877414cd89f8a2d64cd69d080` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:17.526686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceee820877414cd89f8a2d64cd69d080)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:17.529495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:17.531208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:17.533248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:17.545206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 950/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:17.593216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceee820877414cd89f8a2d64cd69d080'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.593969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceee820877414cd89f8a2d64cd69d080'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.602949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceee820877414cd89f8a2d64cd69d080'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.604824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:17.617494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceee820877414cd89f8a2d64cd69d080'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.618771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceee820877414cd89f8a2d64cd69d080'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:17.648168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 974/1924] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:17 2022] DELETE /identity/v3/users/ceee820877414cd89f8a2d64cd69d080 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:18.016460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.018397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.034137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44d3aa-9aaf-46f7-8798-2261c3fc5ca2 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.091349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.093183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.135143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.136057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.136342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.136615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] PATH_INFO: `/v3/projects/0fd09718a5094f0dab013b14ae27a54d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.138249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd09718a5094f0dab013b14ae27a54d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.140803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.179082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89573c-7a4e-4593-a6ca-038c65828624 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.185138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:18.196230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd09718a5094f0dab013b14ae27a54d', 'request_id': 'req-403e2919-7eda-4541-9151-4a9b664fa962'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.204877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd09718a5094f0dab013b14ae27a54d', 'request_id': 'req-403e2919-7eda-4541-9151-4a9b664fa962'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.211233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd09718a5094f0dab013b14ae27a54d', 'request_id': 'req-403e2919-7eda-4541-9151-4a9b664fa962'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.227861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] The token cache is being invalidate because project 0fd09718a5094f0dab013b14ae27a54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:18.228208 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.230038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.232344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 951/1925] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:18 2022] DELETE /identity/v3/projects/0fd09718a5094f0dab013b14ae27a54d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:18.235938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.237642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.245675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.246543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.246814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.247084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] PATH_INFO: `/v3/projects/d7e360047fde42b29b6117ee869882fe` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.248324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e360047fde42b29b6117ee869882fe)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.251012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.306097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e360047fde42b29b6117ee869882fe', 'request_id': 'req-35af974a-cb4f-4bf3-9803-4769515c1955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.312615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e360047fde42b29b6117ee869882fe', 'request_id': 'req-35af974a-cb4f-4bf3-9803-4769515c1955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.322843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e360047fde42b29b6117ee869882fe', 'request_id': 'req-35af974a-cb4f-4bf3-9803-4769515c1955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.330851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2919-7eda-4541-9151-4a9b664fa962 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.338500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] The token cache is being invalidate because project d7e360047fde42b29b6117ee869882fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:18.338798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.339913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-35af974a-cb4f-4bf3-9803-4769515c1955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.343175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 975/1926] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:18 2022] DELETE /identity/v3/projects/d7e360047fde42b29b6117ee869882fe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:18.347537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c554e-b724-4906-b0d6-001d816a640c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.347783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c554e-b724-4906-b0d6-001d816a640c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.348177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c554e-b724-4906-b0d6-001d816a640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.380746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f92c554e-b724-4906-b0d6-001d816a640c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:18.382112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f92c554e-b724-4906-b0d6-001d816a640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.390422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:18.410599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.411528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.411800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.412150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] PATH_INFO: `/v3/users/2c8f7815da64482ba102b1708ea79d89` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.414144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8f7815da64482ba102b1708ea79d89)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.417353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.488982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8f7815da64482ba102b1708ea79d89'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.492874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 976/1927] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:18.499896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8f7815da64482ba102b1708ea79d89'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.500754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.500899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8f7815da64482ba102b1708ea79d89'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.501429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.501542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8f7815da64482ba102b1708ea79d89'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.501842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.514629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8f7815da64482ba102b1708ea79d89'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:18.538601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:18.543896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:18.545128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.561842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 977/1928] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:18.562834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 952/1929] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:18 2022] DELETE /identity/v3/users/2c8f7815da64482ba102b1708ea79d89 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:18.570057 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.582834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf5a9-9378-4efe-afb7-ec4d4ed67323 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.671351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.672155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.672495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.673126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.673966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:18.674346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.676328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.693099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 978/1930] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:29:18.697464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.719546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224dbd6-eb53-43d4-9428-4e4f7593f9bd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.725889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.727045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.727329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.727866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.728995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.731008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.773833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 953/1931] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:18 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:18.779040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.790672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ad5e7-433b-41ac-a2fb-c434b28678a8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.861464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.862144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.862431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.862704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.863402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.865674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.897554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 979/1932] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:18 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:18.900264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.900982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.902199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:18.914007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702af5-d710-4965-8259-5daffd493ee1 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.924525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.925440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.925794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.926142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.927820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.930231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.944911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 980/1933] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:18.948516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:18.965351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206420b-7548-453f-a012-000ff29c4c7f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:18.972087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:18.972596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:18.973050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:18.973332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:18.974332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:18.976806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:18.989807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 981/1934] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:18.994674 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.001605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35019b-a836-44c3-95a1-ebf0926f7f46 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.005468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.005616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28207-cbea-40b5-9c75-0320ffe86ac7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.006654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.006953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.007817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.009764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.027339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.028380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.028714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.029202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] PATH_INFO: `/v3/projects/0cd12417a4014fdf91e4a408ce094aeb/users/819ccaf35b794ec0a6aeaf0eb45938fb/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.044508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:19.071705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd12417a4014fdf91e4a408ce094aeb, user_id=819ccaf35b794ec0a6aeaf0eb45938fb, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.075996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3240c-b0b0-42e1-a340-e275da2474af admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.104561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.106124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.110536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 982/1935] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:18 2022] PUT /identity/v3/projects/0cd12417a4014fdf91e4a408ce094aeb/users/819ccaf35b794ec0a6aeaf0eb45938fb/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:19.120537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 954/1936] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:19.125265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.125766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.126192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.184542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] MFA Rules not processed for user `819ccaf35b794ec0a6aeaf0eb45938fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:19.185678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.262214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.263986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.285472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8793-3e20-4278-90a6-ffb69bbe1a60 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.304085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 983/1937] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:19.308290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.384449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.385855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.386286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.386707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] PATH_INFO: `/v3/projects/54184a22673941b992b92e74bb0bc2da` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.388751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54184a22673941b992b92e74bb0bc2da)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.393315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.426483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:19.430019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e23ca-3445-4b90-abca-cc33bd63bad0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.436510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.437326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.437705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.438054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.438787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.440781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.456247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54184a22673941b992b92e74bb0bc2da', 'request_id': 'req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:19.464442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54184a22673941b992b92e74bb0bc2da', 'request_id': 'req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:19.472945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54184a22673941b992b92e74bb0bc2da', 'request_id': 'req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:19.478456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 984/1938] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:19.482867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.487649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] The token cache is being invalidate because project 54184a22673941b992b92e74bb0bc2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:19.487996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:19.488805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b30d08cd-04e7-4505-8e3d-3bc04c2e0935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:19.490474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 955/1939] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:19 2022] DELETE /identity/v3/projects/54184a22673941b992b92e74bb0bc2da => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:19.496991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41e70-16c1-485e-9726-b5219c79f473 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.497296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41e70-16c1-485e-9726-b5219c79f473 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.497575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41e70-16c1-485e-9726-b5219c79f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.520663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-69c41e70-16c1-485e-9726-b5219c79f473 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:19.522111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-69c41e70-16c1-485e-9726-b5219c79f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.551026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:19.552915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdfc6-7b02-4b3f-8ce7-6d3432bbfdaa admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.562458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.563382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.563824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.564485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.565197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.567398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.603791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 985/1940] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:19.606230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.609771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.616206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 956/1941] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:19.626092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.626390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.626860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.633773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70d56-cc51-4a46-a99a-5f72c3c679f5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.639871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.640744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.641133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.641512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.642354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.644401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.650624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:19.652122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.658188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 986/1942] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:19.661848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.668975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 957/1943] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:19.679082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.683248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f853d5-d4d7-4d55-b08f-3c11650c575a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.697590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.698001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.698208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.698489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.699234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.701177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.720689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 987/1944] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:19.725320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.728131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b772-21b4-4d00-bb16-5b7ee8a8d44a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.738267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727b0a-9e75-4a77-986e-bdf1f7c67cc6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.747536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.748401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.749873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.750297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.750837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.751762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:19.752312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.752508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.752874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.754170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] PATH_INFO: `/v3/projects/a974a190f92c484d9f49fbd780f63a3b/users/7116be89d859418fa114ed9b2325c566/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.754606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.781858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a974a190f92c484d9f49fbd780f63a3b, user_id=7116be89d859418fa114ed9b2325c566, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.783285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 958/1945] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:19.785710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd634-a436-4236-ad03-da313b0187b1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.788621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.805339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 988/1946] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:19 2022] PUT /identity/v3/projects/a974a190f92c484d9f49fbd780f63a3b/users/7116be89d859418fa114ed9b2325c566/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:19.811948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb38892-ae3a-46db-a53b-dfc2542ac977 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.817175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.817524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.818156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.857818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] MFA Rules not processed for user `7116be89d859418fa114ed9b2325c566`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:19.859146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:19.916473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:19.917143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:19.917421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:19.917931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:19.918957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:19.921969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:19.945627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 989/1947] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:19.950158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:19.978468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 959/1948] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:19.979831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59b31-5368-48fb-9eca-c76fb2742f1e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:19.982205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.010917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:20.064380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.065971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.067526 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.069068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.069998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.074446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.083587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09671-6517-464f-9c7e-f71622532550 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.100156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.101169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.102063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.103580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.105625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.113122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.142749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 990/1949] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:20.146797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.156703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 960/1950] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:19 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:20.163569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.198357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b275-568f-4a00-b577-bcb5de594a2e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.200647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:20.293720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.294752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.296340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.296776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.298334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.301017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.320213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 961/1951] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:20.325146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.338450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4be5e-62ab-4204-abba-1c080971cebf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.345676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.346726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423c83-8b57-48b7-aa19-954c84040573 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.346973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.347266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.347539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.348314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.350812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.354238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.356820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.359193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.359632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.361044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.363891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.368975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 962/1952] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:20.369853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.394345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7967-5e4c-4709-8e21-f1b0ba0e695e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.402906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.403832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.408181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.408395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] PATH_INFO: `/v3/projects/b80bb50bbc24493b9463e4257e37ac79/users/1078ff1d81da4c86ba148e91fd3457ab/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.410131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 991/1953] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:20 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:20.411293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.423973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed373ba-c290-47f5-baad-cb558a8c3069 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.433202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80bb50bbc24493b9463e4257e37ac79, user_id=1078ff1d81da4c86ba148e91fd3457ab, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.437504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74cd3-41b2-4a80-a643-306ff80576fc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.447314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.448932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.449249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.449535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.453168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.455925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.458906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 963/1954] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:20 2022] PUT /identity/v3/projects/b80bb50bbc24493b9463e4257e37ac79/users/1078ff1d81da4c86ba148e91fd3457ab/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:20.469517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.469800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.470101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.478486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 992/1955] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:20.482194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.493833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d90a0-4f44-48f7-9bee-b6fb05a5449c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.512264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] MFA Rules not processed for user `1078ff1d81da4c86ba148e91fd3457ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:20.513861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:20.572122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.573148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.573435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.573715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] PATH_INFO: `/v3/projects/71af895b4dc642d796aceb3c00785f43/users/9a8a38ff59344bd3ae59593a81823746/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.589093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:20.591578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71af895b4dc642d796aceb3c00785f43, user_id=9a8a38ff59344bd3ae59593a81823746, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.594635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.605221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 964/1956] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:20.615137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.616572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:20.617741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 993/1957] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:20 2022] PUT /identity/v3/projects/71af895b4dc642d796aceb3c00785f43/users/9a8a38ff59344bd3ae59593a81823746/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:20.621834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.695805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dbfe2-a13a-4390-a912-373d2d030b8d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.707878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f19bf-d94c-48cf-b06d-e5eb768b1c84 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.729134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.730849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.731650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.732310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.733367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.736343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.755622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 994/1958] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:20.756426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.765828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.767132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.767682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.768160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.770012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e034b92-0aa7-4b51-9a6c-5e2f491ba775 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:20.774959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:20.776497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.776497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.776884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] PATH_INFO: `/v3/projects/71af895b4dc642d796aceb3c00785f43/users/9a8a38ff59344bd3ae59593a81823746/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.779387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71af895b4dc642d796aceb3c00785f43, user_id=9a8a38ff59344bd3ae59593a81823746, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.783111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218c83-6c4a-4ffd-bd36-51c9e06fa757 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.797891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:20.806061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 995/1959] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:20 2022] PUT /identity/v3/projects/71af895b4dc642d796aceb3c00785f43/users/9a8a38ff59344bd3ae59593a81823746/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:20.816064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:20.816334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:20.816611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:20.851816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] MFA Rules not processed for user `9a8a38ff59344bd3ae59593a81823746`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:20.853604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:20.854123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:20.856177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:20.867879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 965/1960] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:20.948127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 996/1961] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:20.957503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:20.958977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:21.042339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9c7e7-3fca-4786-aed0-b652bdb3acc1 service glance] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:21.065664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:21.103048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:21.103834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:21.104265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:21.104439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:21.115778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:21.117273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:21.128973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 966/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:21.846755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:21.861468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461aef4-cefa-465a-8d40-cd2afea605a9 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:21.865222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:21.865947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:21.866153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:21.866431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:21.868511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:21.958924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:21.960598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd170e-eb1c-4f9e-be41-f7cad050caaf service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:21.971907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 997/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:23.214480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:23.216002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:23.305737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622f-c93a-4b49-aee0-366bf550cdab service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:23.319399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:23.320490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:23.320874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:23.321252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] PATH_INFO: `/v3/users/e2b43223a013415ab8a481cc7392ee46` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:23.322702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b43223a013415ab8a481cc7392ee46)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:23.324810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:23.391639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b43223a013415ab8a481cc7392ee46'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:23.399542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b43223a013415ab8a481cc7392ee46'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:23.400267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b43223a013415ab8a481cc7392ee46'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:23.401436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b43223a013415ab8a481cc7392ee46'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:23.419593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b43223a013415ab8a481cc7392ee46'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:23.443015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 967/1964] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:23 2022] DELETE /identity/v3/users/e2b43223a013415ab8a481cc7392ee46 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:23.447867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:23.452358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:23.452664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:23.496191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:23.496191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:23.600952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 998/1965] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:23.611576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:23.613285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:23.670024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:23.686504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2319f-d5e0-4cac-809b-908be7657ce0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:23.690764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:23.691796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:23.692288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:23.692754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:23.704873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:23.706785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:23.719118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 968/1966] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:24.577349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:24.579458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:24.604040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67951-4b62-45fc-9095-8c28e00fc6de None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:24.611508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:24.612962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:24.613400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:24.614232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] PATH_INFO: `/v3/projects/ef7b964c09624f27999c9d924a41e243` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:24.616103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7b964c09624f27999c9d924a41e243)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:24.620104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:24.647609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:24.685079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7b964c09624f27999c9d924a41e243', 'request_id': 'req-80486a1d-c4b8-48a6-80d3-d728224a2b01'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:24.692532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7b964c09624f27999c9d924a41e243', 'request_id': 'req-80486a1d-c4b8-48a6-80d3-d728224a2b01'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:24.703874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7b964c09624f27999c9d924a41e243', 'request_id': 'req-80486a1d-c4b8-48a6-80d3-d728224a2b01'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:24.729467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] The token cache is being invalidate because project ef7b964c09624f27999c9d924a41e243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:24.730360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:24.731777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:24.734855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 999/1967] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:24 2022] DELETE /identity/v3/projects/ef7b964c09624f27999c9d924a41e243 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:24.738620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:24.749598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246863-a9fc-462b-be3f-e7e99629887c service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:24.931207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:24.936845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:24.937411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:24.937853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] PATH_INFO: `/v3/users/11959cc567a34888a6804bb540aef35c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:24.939559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=11959cc567a34888a6804bb540aef35c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:24.948536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:25.048303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11959cc567a34888a6804bb540aef35c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.064808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11959cc567a34888a6804bb540aef35c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.065624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11959cc567a34888a6804bb540aef35c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.066255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11959cc567a34888a6804bb540aef35c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.081499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-eef86b3a-15f1-40e8-aac2-93b357c1f7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11959cc567a34888a6804bb540aef35c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.116649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 969/1968] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:24 2022] DELETE /identity/v3/users/11959cc567a34888a6804bb540aef35c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:25.630363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:25.632396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:25.663726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486a1d-c4b8-48a6-80d3-d728224a2b01 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:25.798962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:25.800125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:25.800472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:25.800799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] PATH_INFO: `/v3/projects/404bdd7715a840f9b411acb9b0b34f3d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:25.802254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404bdd7715a840f9b411acb9b0b34f3d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:25.804436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:25.871892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404bdd7715a840f9b411acb9b0b34f3d', 'request_id': 'req-0bea8231-f385-402e-98a2-95fa1a16fc13'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.881737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404bdd7715a840f9b411acb9b0b34f3d', 'request_id': 'req-0bea8231-f385-402e-98a2-95fa1a16fc13'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.896634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404bdd7715a840f9b411acb9b0b34f3d', 'request_id': 'req-0bea8231-f385-402e-98a2-95fa1a16fc13'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.915178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] The token cache is being invalidate because project 404bdd7715a840f9b411acb9b0b34f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:25.915531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.916263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bea8231-f385-402e-98a2-95fa1a16fc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:25.924241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1000/1969] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:25 2022] DELETE /identity/v3/projects/404bdd7715a840f9b411acb9b0b34f3d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:25.924558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:25.925045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:25.925132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:25.948259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:25.949480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:26.026309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 970/1970] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:26.034562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.034851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.035129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.056408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:26.057636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:26.065957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1001/1971] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:26.070288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.080678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24801e7-0233-48d2-a2ba-4e2a6ea84f5e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.085343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.086019 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.086302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.086576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.087493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:26.087798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.089603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.091215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:26.104092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 971/1972] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:26.108884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.118351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c59b75-5b73-4b78-8012-819f2c1c9b02 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.122947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.123613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.123880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.124189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.124988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.127074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.158307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1002/1973] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:26.162176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.172579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922847-af07-4366-86d3-55d87aa1b59b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.245414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.246167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.246606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.246951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.247760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.249876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.276218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 972/1974] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:26.278437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.293035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc43658-dd08-4b0e-9e26-272bb0eacf24 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.306912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.307250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.307530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.308860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.309608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.311341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.314255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:26.334191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1003/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:26.340663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.352195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226759-eeff-4171-95de-423e33ded15e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.359514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.360352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.360703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.361052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.362031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.363771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a960-2d79-4118-900d-b9f7b78a383b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.379204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.386885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 973/1976] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:26.392117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c4b4-efe5-45ba-83ea-82aa60c875e2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.399133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.400237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.400606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.400943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] PATH_INFO: `/v3/projects/39ab9c736af54147ad9062d63b3af4ef/users/438bca2c39454f8cb7dcbc28f03e4546/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.420464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ab9c736af54147ad9062d63b3af4ef, user_id=438bca2c39454f8cb7dcbc28f03e4546, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.424562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.475429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1004/1977] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:26 2022] PUT /identity/v3/projects/39ab9c736af54147ad9062d63b3af4ef/users/438bca2c39454f8cb7dcbc28f03e4546/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:26.477451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.478269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.478742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.513159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] MFA Rules not processed for user `438bca2c39454f8cb7dcbc28f03e4546`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:26.515289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:26.655439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 974/1978] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:26.659119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.691677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.696814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:26.824691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b5f-bb88-47fb-906c-760eefd20d6d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.834840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.835519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.835803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.838446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.839203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.842170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:26.868540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160dc3-b54c-4522-abb9-e48a66e465fe None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:26.878701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:26.879615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:26.880330 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:26.880929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:26.883720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:26.903539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:26.922877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1005/1979] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:26.926823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:26.985959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:26.987554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.005024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 975/1980] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:27.055911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a3365-aff6-43db-a89c-2bf6750556f5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:27.063012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:27.064101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.064460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.065115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.066635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:27.069933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.111316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1006/1981] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:26 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:27.115090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:27.133511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083305c3-e8d3-4b37-ba30-03c80af01a5a service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:27.145084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:27.146969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.147404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.147823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.148953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:27.151418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.172156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 976/1982] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:27.176371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:27.187825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5856-97cf-4baf-9820-bed9db39b96b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:27.194585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:27.195731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.196010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.196562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] PATH_INFO: `/v3/projects/75876b00e6f346a89948d10a18dff541/users/8ffb4bbce00143fd8daa11b7c58b9074/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.215004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75876b00e6f346a89948d10a18dff541, user_id=8ffb4bbce00143fd8daa11b7c58b9074, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:27.218883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.245235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1007/1983] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:27 2022] PUT /identity/v3/projects/75876b00e6f346a89948d10a18dff541/users/8ffb4bbce00143fd8daa11b7c58b9074/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:27.246241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:27.257644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed3ace-7d68-456b-b64e-9a6ac1d43105 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:27.336046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:27.336744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.337029 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.337306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.338043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:27.339715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741214af-e1db-465a-b77c-62197ebd6518 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.362483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:27.364313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 977/1984] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:27.373027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952958ba-9be9-42ba-826b-26b6ed82fc81 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:27.379641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:27.380768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.381198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.381479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] PATH_INFO: `/v3/projects/75876b00e6f346a89948d10a18dff541/users/8ffb4bbce00143fd8daa11b7c58b9074/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.383586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75876b00e6f346a89948d10a18dff541, user_id=8ffb4bbce00143fd8daa11b7c58b9074, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:27.387326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:27.401358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1008/1985] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:27 2022] PUT /identity/v3/projects/75876b00e6f346a89948d10a18dff541/users/8ffb4bbce00143fd8daa11b7c58b9074/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:27.412509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:27.412788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:27.412965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:27.446265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] MFA Rules not processed for user `8ffb4bbce00143fd8daa11b7c58b9074`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:27.447526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:27.548931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 978/1986] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:29.246628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:29.264340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:29.333221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b7b6-2ecb-4b74-86ab-99ed4a466690 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:29.339458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:29.340308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:29.340454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:29.340721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:29.353552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:29.355014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dc80f-8637-4b46-8495-7d26c50a974c service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:29.376229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1009/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:29.566084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:29.567678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:29.614923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:29.659843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912fee-9f9b-4a5c-a1cf-1f4f971c8280 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:29.668206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:29.669269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:29.669535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:29.669955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] PATH_INFO: `/v3/users/1ed74052464f4639bcef46e1a7515c01` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:29.671833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed74052464f4639bcef46e1a7515c01)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:29.674221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:29.797379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed74052464f4639bcef46e1a7515c01'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:29.820488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed74052464f4639bcef46e1a7515c01'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:29.821212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed74052464f4639bcef46e1a7515c01'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:29.821849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed74052464f4639bcef46e1a7515c01'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:29.830248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed74052464f4639bcef46e1a7515c01'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:29.861113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:29.861481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:29.861820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:29.863492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 979/1988] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:29 2022] DELETE /identity/v3/users/1ed74052464f4639bcef46e1a7515c01 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:29.866160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:29.869315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:29.885467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:29.886956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:29.983028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9118c-bb11-4d63-90cd-a608f7d46583 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:29.983695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1010/1989] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:29.989715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffb4bbce00143fd8daa11b7c58b9074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75876b00e6f346a89948d10a18dff541', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:29.990653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:29.990848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:29.992389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:29.992693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:29.992970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:29.993455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:29.993956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:29.995549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.019859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 980/1990] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:30.020855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.033736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87226d6-79e9-4cb9-a2ba-152c0286536f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.038634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffb4bbce00143fd8daa11b7c58b9074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75876b00e6f346a89948d10a18dff541', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.039379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.040188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.040188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.041192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.043429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.088723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 981/1991] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:30 2022] POST /identity/v3/projects => generated 354 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:30.093083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.105202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac92b9-f42f-4a16-8aca-f075e3dd1c24 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.118615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:30.162053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.162492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.162773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.163045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.180831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8438-3215-4f40-ba70-698325efd86f tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.186187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffb4bbce00143fd8daa11b7c58b9074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75876b00e6f346a89948d10a18dff541', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.187094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.187558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.187987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.188898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:30.189356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.190351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:30.192063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.207056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 982/1992] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:29:30.246195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.248855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.258263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.259471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1011/1993] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:30.270347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690bc1d-6b1c-4b4a-adfe-f367bde46604 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.276791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffb4bbce00143fd8daa11b7c58b9074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75876b00e6f346a89948d10a18dff541', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.280158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.280158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.280158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] PATH_INFO: `/v3/projects/af765a7e88d649428977866ba6873414` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.281032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af765a7e88d649428977866ba6873414)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.283013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.349800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af765a7e88d649428977866ba6873414', 'request_id': 'req-baa6a382-e535-457d-8398-1b3db7970fc7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.362967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af765a7e88d649428977866ba6873414', 'request_id': 'req-baa6a382-e535-457d-8398-1b3db7970fc7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.372932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af765a7e88d649428977866ba6873414', 'request_id': 'req-baa6a382-e535-457d-8398-1b3db7970fc7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.385152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] The token cache is being invalidate because project af765a7e88d649428977866ba6873414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:30.385530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.386123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.387708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 983/1994] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:30 2022] DELETE /identity/v3/projects/af765a7e88d649428977866ba6873414 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:30.652084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.654276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:30.678694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1521bea-8e6c-4810-aef5-d8c878c24b01 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.727416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.729921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:30.788236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.789660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.790114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.791013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] PATH_INFO: `/v3/projects/d303da96e8ab414bb09075396cff1011` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.793955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d303da96e8ab414bb09075396cff1011)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.800688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.856536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6a382-e535-457d-8398-1b3db7970fc7 tempest-VolumeQuotaClassesTest-969251919 tempest-VolumeQuotaClassesTest-969251919-project-admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:30.864857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:30.866463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:30.866822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:30.867284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] PATH_INFO: `/v3/users/438bca2c39454f8cb7dcbc28f03e4546` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:30.869872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=438bca2c39454f8cb7dcbc28f03e4546)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:30.872952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:30.877105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd303da96e8ab414bb09075396cff1011', 'request_id': 'req-3c16c7b2-6657-404a-8e2e-308b90531736'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.883974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd303da96e8ab414bb09075396cff1011', 'request_id': 'req-3c16c7b2-6657-404a-8e2e-308b90531736'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.893586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd303da96e8ab414bb09075396cff1011', 'request_id': 'req-3c16c7b2-6657-404a-8e2e-308b90531736'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.929412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] The token cache is being invalidate because project d303da96e8ab414bb09075396cff1011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:30.929982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.931143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:30.938278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1012/1995] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:30 2022] DELETE /identity/v3/projects/d303da96e8ab414bb09075396cff1011 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:30.943198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:30.946613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:30.947897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:30.991875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438bca2c39454f8cb7dcbc28f03e4546'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.013338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438bca2c39454f8cb7dcbc28f03e4546'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.014140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438bca2c39454f8cb7dcbc28f03e4546'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.014902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438bca2c39454f8cb7dcbc28f03e4546'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.034214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4aebee8-14e8-4240-9c7c-8ad5499cd66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438bca2c39454f8cb7dcbc28f03e4546'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.069833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 984/1996] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:30 2022] DELETE /identity/v3/users/438bca2c39454f8cb7dcbc28f03e4546 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:31.071376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.071670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.071948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.103876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:31.105719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:31.106967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.133325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16c7b2-6657-404a-8e2e-308b90531736 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:31.266366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 985/1997] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:31.276624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:31.278114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.295855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:31.297932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.298382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.298892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] PATH_INFO: `/v3/users/61c4587a55024f3d9070235f5c3d8060` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.300647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c4587a55024f3d9070235f5c3d8060)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:31.303323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:31.391211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c4587a55024f3d9070235f5c3d8060'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.391950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c4587a55024f3d9070235f5c3d8060'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.401708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c4587a55024f3d9070235f5c3d8060'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.410931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e246d7-073e-4e3f-86bd-3c57e3251d96 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:31.413754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:31.414581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.414910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.415367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.420812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c4587a55024f3d9070235f5c3d8060'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.421901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c4587a55024f3d9070235f5c3d8060'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.435304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:31.437147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04c2d-a93f-4855-a329-6d225c454e1c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:31.447860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1013/1998] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:30 2022] DELETE /identity/v3/users/61c4587a55024f3d9070235f5c3d8060 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:31.448770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:31.449972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 986/1999] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:31.450104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.543381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6cf-aa6a-42a8-a7c3-79aa0ca29b7c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:31.551647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:31.552561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.552851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.553133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] PATH_INFO: `/v3/users/819ccaf35b794ec0a6aeaf0eb45938fb` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.555470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=819ccaf35b794ec0a6aeaf0eb45938fb)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:31.558680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:31.596123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:31.649981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819ccaf35b794ec0a6aeaf0eb45938fb'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.651076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819ccaf35b794ec0a6aeaf0eb45938fb'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.660423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819ccaf35b794ec0a6aeaf0eb45938fb'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.678658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819ccaf35b794ec0a6aeaf0eb45938fb'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.692048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819ccaf35b794ec0a6aeaf0eb45938fb'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:31.716928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1014/2000] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:31 2022] DELETE /identity/v3/users/819ccaf35b794ec0a6aeaf0eb45938fb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:31.721832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.722228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.722607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.745227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:31.746913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.810662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:31.826548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 987/2001] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:31.845845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:31.849975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.908789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:31.910297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:31.928997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5142-9024-4d65-b4f2-8acb029b37f7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:31.956690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:31.957586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.957868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.958134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] PATH_INFO: `/v3/projects/c9229da7906a48cdbc5a81daf7599df0` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.959469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9229da7906a48cdbc5a81daf7599df0)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:31.962620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:31.965181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486bf2e-b3e9-42ea-92e2-c4668b7fc33e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:31.973894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:31.974574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:31.974863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:31.975141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:31.990362 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:31.992153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.004085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1015/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:32.005134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.006621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.025761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894523fc-4647-4153-80bc-ff215494f532 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.033108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.033976 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.034259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.034588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] PATH_INFO: `/v3/projects/39ab9c736af54147ad9062d63b3af4ef` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.035858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ab9c736af54147ad9062d63b3af4ef)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.038566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.070144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9229da7906a48cdbc5a81daf7599df0', 'request_id': 'req-db38c881-0a5a-444a-8b42-4c577fd1fb05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.083528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9229da7906a48cdbc5a81daf7599df0', 'request_id': 'req-db38c881-0a5a-444a-8b42-4c577fd1fb05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.093280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9229da7906a48cdbc5a81daf7599df0', 'request_id': 'req-db38c881-0a5a-444a-8b42-4c577fd1fb05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.104856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ab9c736af54147ad9062d63b3af4ef', 'request_id': 'req-ce655068-2e6d-481c-88ae-2fadc92e9f46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.107038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] The token cache is being invalidate because project c9229da7906a48cdbc5a81daf7599df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:32.107422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.110053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-db38c881-0a5a-444a-8b42-4c577fd1fb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.114928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 988/2003] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:31 2022] DELETE /identity/v3/projects/c9229da7906a48cdbc5a81daf7599df0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:32.119277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ab9c736af54147ad9062d63b3af4ef', 'request_id': 'req-ce655068-2e6d-481c-88ae-2fadc92e9f46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.126121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fa0c-85be-42fc-b426-c88c30672acd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.126422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fa0c-85be-42fc-b426-c88c30672acd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.126824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fa0c-85be-42fc-b426-c88c30672acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.130050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ab9c736af54147ad9062d63b3af4ef', 'request_id': 'req-ce655068-2e6d-481c-88ae-2fadc92e9f46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.144539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] The token cache is being invalidate because project 39ab9c736af54147ad9062d63b3af4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:32.145051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.146451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.148896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1016/2004] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:32 2022] DELETE /identity/v3/projects/39ab9c736af54147ad9062d63b3af4ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:32.152767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.153158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d964fa0c-85be-42fc-b426-c88c30672acd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:32.155091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d964fa0c-85be-42fc-b426-c88c30672acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.155574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.196058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:32.281113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655068-2e6d-481c-88ae-2fadc92e9f46 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.287712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.289083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.289670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.290099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] PATH_INFO: `/v3/users/8ffb4bbce00143fd8daa11b7c58b9074` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.290797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 989/2005] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:32.292121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffb4bbce00143fd8daa11b7c58b9074)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.292353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.292653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.292932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.295539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.323835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:32.325229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.335852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 990/2006] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:32.340077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.351033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315bd9-3e87-4611-84d1-530c256e5793 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.356858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.357671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.358018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.358381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.359698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:32.360134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.361955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.375867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffb4bbce00143fd8daa11b7c58b9074'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.376777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffb4bbce00143fd8daa11b7c58b9074'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.390092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 991/2007] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:29:32.390763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffb4bbce00143fd8daa11b7c58b9074'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.391651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.406053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffb4bbce00143fd8daa11b7c58b9074'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.407298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffb4bbce00143fd8daa11b7c58b9074'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.412394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fee69-d7c5-47da-9dbe-185495a0e549 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.418299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.419237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.419914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.420277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.420955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.422927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.460356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 992/2008] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:32 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:32.460356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.462351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.464112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1017/2009] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:32 2022] DELETE /identity/v3/users/8ffb4bbce00143fd8daa11b7c58b9074 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:32.464490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.467973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.530411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:32.561580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0db71-a253-4941-8901-a7464d541fdf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.600803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14752c6a-f055-4331-9376-97570b4da3fa admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.606607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.608857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.609308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.609663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.610437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.612531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.640078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1018/2010] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:32 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:32.641683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.642312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.642676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.642820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.643075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] PATH_INFO: `/v3/projects/0cd12417a4014fdf91e4a408ce094aeb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.644410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd12417a4014fdf91e4a408ce094aeb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.646533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.659798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4f4e-631e-4229-9192-c9b2a4b049b7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.674829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.675616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.675898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.676314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.677611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.683433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.702968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1019/2011] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:32.707987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.723420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd12417a4014fdf91e4a408ce094aeb', 'request_id': 'req-9e963881-d9c3-4c16-afc6-5a7233fcd723'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.724718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee0d2-a42c-43a3-805c-c0c6558f821a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.735025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd12417a4014fdf91e4a408ce094aeb', 'request_id': 'req-9e963881-d9c3-4c16-afc6-5a7233fcd723'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.745344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd12417a4014fdf91e4a408ce094aeb', 'request_id': 'req-9e963881-d9c3-4c16-afc6-5a7233fcd723'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.753660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:32.768756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] The token cache is being invalidate because project 0cd12417a4014fdf91e4a408ce094aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:32.769114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.769773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.771495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 993/2012] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:32 2022] DELETE /identity/v3/projects/0cd12417a4014fdf91e4a408ce094aeb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:32.775451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.777030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.864646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.865341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.865622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.865898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.866691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.868352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.870628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963881-d9c3-4c16-afc6-5a7233fcd723 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.876568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.877607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.877945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.878420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] PATH_INFO: `/v3/users/7116be89d859418fa114ed9b2325c566` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.879842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7116be89d859418fa114ed9b2325c566)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.881051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1020/2013] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:32.881906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.882138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.884107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.896700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73e69d-f122-406f-9f49-430307357336 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:32.901957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:32.903297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.903297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.903492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] PATH_INFO: `/v3/projects/75876b00e6f346a89948d10a18dff541` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:32.904636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75876b00e6f346a89948d10a18dff541)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:32.906709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:32.915030 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:32.948784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7116be89d859418fa114ed9b2325c566'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.956090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7116be89d859418fa114ed9b2325c566'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.956788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7116be89d859418fa114ed9b2325c566'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.957478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7116be89d859418fa114ed9b2325c566'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.959094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75876b00e6f346a89948d10a18dff541', 'request_id': 'req-745bfc96-4e43-4906-9c87-45a9283231b1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.964656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47e82303-4a3c-42f8-98a5-6d82a26a0c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7116be89d859418fa114ed9b2325c566'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.965176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75876b00e6f346a89948d10a18dff541', 'request_id': 'req-745bfc96-4e43-4906-9c87-45a9283231b1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.972991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75876b00e6f346a89948d10a18dff541', 'request_id': 'req-745bfc96-4e43-4906-9c87-45a9283231b1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.985386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] The token cache is being invalidate because project 75876b00e6f346a89948d10a18dff541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:32.985667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.986379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:32.987931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1021/2015] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:32 2022] DELETE /identity/v3/projects/75876b00e6f346a89948d10a18dff541 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:32.991182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 994/2015] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:32 2022] DELETE /identity/v3/users/7116be89d859418fa114ed9b2325c566 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:32.991382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:32.991382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:32.992766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f61bc-1ae7-420a-a188-5dd6158eacb1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:32.993239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f61bc-1ae7-420a-a188-5dd6158eacb1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:32.993563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f61bc-1ae7-420a-a188-5dd6158eacb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.012511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ec1f61bc-1ae7-420a-a188-5dd6158eacb1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:33.013898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ec1f61bc-1ae7-420a-a188-5dd6158eacb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.062954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bfc96-4e43-4906-9c87-45a9283231b1 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.100116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 995/2016] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:33.109299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.109603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.109856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.135432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:33.136761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.140671 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:33.147923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 996/2017] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:33.151590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.166629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.167673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.167964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.171101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] PATH_INFO: `/v3/projects/39e32edabf344625bfc0bc7d603c7f08/users/f85fd6b146ed41e99476296be46cfd12/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.174807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e57cf-ffff-46ac-8637-870c69e608ee None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.192472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.193637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.194351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.194794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.196545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:33.197913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.200762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e32edabf344625bfc0bc7d603c7f08, user_id=f85fd6b146ed41e99476296be46cfd12, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.201614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.203696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010bc2-9a35-4dc9-83ec-96f829b6d5cd admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.222064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 997/2018] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:33.223391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.231577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1022/2019] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:32 2022] PUT /identity/v3/projects/39e32edabf344625bfc0bc7d603c7f08/users/f85fd6b146ed41e99476296be46cfd12/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:33.237859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22acaa-b2bd-4b50-81cd-f2eafa8c346d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.246974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.246974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.246974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.283288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] MFA Rules not processed for user `f85fd6b146ed41e99476296be46cfd12`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:33.284766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.323043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.323925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.324475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.324947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.326217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.328726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.381190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 998/2020] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:33 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:33.382234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.397870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:33.462312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1023/2021] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:33.464384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.466866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.485258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c0e40-507e-4777-ae71-a5e80fd47d24 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.508440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625f14-a3a0-4d51-8cd1-b31bd2e735aa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.513162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.513860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.514143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.514425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.515111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.517079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.541709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 999/2022] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:33 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:33.541709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.541709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.549729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.550607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.550892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.551195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] PATH_INFO: `/v3/projects/a974a190f92c484d9f49fbd780f63a3b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.552428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a974a190f92c484d9f49fbd780f63a3b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.554387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.604090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd6b6-3b84-4b12-ac34-c553b2031473 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.604604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a974a190f92c484d9f49fbd780f63a3b', 'request_id': 'req-5c4ca3a6-2330-4a15-8b09-b85904a437d9'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.612492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a974a190f92c484d9f49fbd780f63a3b', 'request_id': 'req-5c4ca3a6-2330-4a15-8b09-b85904a437d9'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.615523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:33.621871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a974a190f92c484d9f49fbd780f63a3b', 'request_id': 'req-5c4ca3a6-2330-4a15-8b09-b85904a437d9'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.634880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] The token cache is being invalidate because project a974a190f92c484d9f49fbd780f63a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:33.635181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.635825 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.637441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1024/2023] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:33 2022] DELETE /identity/v3/projects/a974a190f92c484d9f49fbd780f63a3b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:33.638203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.640062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.662218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.662872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.663154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.663436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.665276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.707688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca3a6-2330-4a15-8b09-b85904a437d9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.712475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.713149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.713427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.713706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.714440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.716105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.726927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1025/2024] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:33.727993 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.729660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.734371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.735891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.742275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc8a6-5753-4293-be3e-2a073ff31f2c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.745011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1000/2025] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:33.745811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.747684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.748677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.748963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.749240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] PATH_INFO: `/v3/users/9a8a38ff59344bd3ae59593a81823746` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.750457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8a38ff59344bd3ae59593a81823746)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.752351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:33.753110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.761038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234bfa-726f-46ba-9108-268468b18769 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.772243 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.772978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.773267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.773543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.774277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.775897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.791016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1001/2026] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:33.791863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.793630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.808362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84edd1-da1d-414b-8ccf-7924336b7cd0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:33.813020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:33.813881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.814308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.814439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] PATH_INFO: `/v3/users/f85fd6b146ed41e99476296be46cfd12` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.815628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85fd6b146ed41e99476296be46cfd12)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:33.817587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:33.819003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8a38ff59344bd3ae59593a81823746'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.819565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8a38ff59344bd3ae59593a81823746'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.826926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8a38ff59344bd3ae59593a81823746'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.835183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8a38ff59344bd3ae59593a81823746'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.835813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8a38ff59344bd3ae59593a81823746'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.857586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1026/2027] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:33 2022] DELETE /identity/v3/users/9a8a38ff59344bd3ae59593a81823746 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:33.858532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:33.859929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.871619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85fd6b146ed41e99476296be46cfd12'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.882657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85fd6b146ed41e99476296be46cfd12'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.883420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85fd6b146ed41e99476296be46cfd12'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.884081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85fd6b146ed41e99476296be46cfd12'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.893378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-79bc0af3-b44c-422d-a48d-c44d1be5327e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85fd6b146ed41e99476296be46cfd12'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:33.928118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1002/2028] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:33 2022] DELETE /identity/v3/users/f85fd6b146ed41e99476296be46cfd12 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:33.932947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:33.933462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:33.933959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:33.966577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:33.968494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:33.970536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:33.971635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0d11-982c-4855-a382-5d2294d87ea9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.049000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.050037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.050354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.050553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] PATH_INFO: `/v3/projects/5139263e1e534152a2a3699769507bb7/users/7c818560ac044f14919c16fe8c7b7e5c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.056306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1003/2029] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:34.063441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.066591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:34.079303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5139263e1e534152a2a3699769507bb7, user_id=7c818560ac044f14919c16fe8c7b7e5c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.082369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45790200-7595-44cb-8550-7e13c85659a1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.108079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1027/2030] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:33 2022] PUT /identity/v3/projects/5139263e1e534152a2a3699769507bb7/users/7c818560ac044f14919c16fe8c7b7e5c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:34.121972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.122734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.122734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.169137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] MFA Rules not processed for user `7c818560ac044f14919c16fe8c7b7e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:34.170417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:34.180753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41265fd-b53a-4af9-9d63-7afd57578eef None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.200994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:34.255966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.257195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.257476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.257806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.260002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1028/2031] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:34.265152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.266417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:34.332525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.334051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.339591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043bdba-1340-46b0-ab49-97dbcf963e59 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.344774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.345687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.345816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1004/2032] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:34.345901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.345989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.346675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.348663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.380203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1029/2033] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:34 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:34.386554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.398513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5c7c-780f-47e6-8fbb-4b084863755a service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.484886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.485667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.486027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.486382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.487157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.489615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.520064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1005/2034] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:34 2022] POST /identity/v3/users => generated 307 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:34.520256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.529050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:34.542725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2485-b3fc-4c17-a0de-e9a5cf52d4dc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.556095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.556867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.557146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.557413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.558146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.559764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.576091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1030/2035] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:34.578925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.593934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8be42-6a73-43f4-b83e-3ea4a420ce19 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.598691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.599697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.599988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.600836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] PATH_INFO: `/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0/users/b62af126c45a4d0bb41a807c9f849a82/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.626621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c223c3c64ae4e2281ed6332ac1023c0, user_id=b62af126c45a4d0bb41a807c9f849a82, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.629635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.647451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1006/2036] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:34 2022] PUT /identity/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0/users/b62af126c45a4d0bb41a807c9f849a82/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:34.651347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.666888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed0d9-669d-41ea-8f58-fccbd664bc2c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.686242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.688596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:34.761660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:34.794824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.796939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.797309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.797887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.798764 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.800724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81691b-4d09-4549-98ab-4e8f113efeb2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.801029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.807279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.808334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.808804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.809036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] PATH_INFO: `/v3/projects/71af895b4dc642d796aceb3c00785f43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.810438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71af895b4dc642d796aceb3c00785f43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.813302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.816810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1031/2037] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:34.817756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:34.834558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc77e0f-e788-4f69-a2cb-bddab47433e7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:34.844607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:34.845525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.846302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.847017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] PATH_INFO: `/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0/users/b62af126c45a4d0bb41a807c9f849a82/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.850531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c223c3c64ae4e2281ed6332ac1023c0, user_id=b62af126c45a4d0bb41a807c9f849a82, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:34.855052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678c4d3-e2de-4a6b-abd7-fc3dac9b7c47 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:34.879589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71af895b4dc642d796aceb3c00785f43', 'request_id': 'req-e05eeecf-6e2a-4c67-8212-9cc910f58876'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:34.881052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1032/2038] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:34 2022] PUT /identity/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0/users/b62af126c45a4d0bb41a807c9f849a82/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:34.882576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.882868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.883152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.890495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71af895b4dc642d796aceb3c00785f43', 'request_id': 'req-e05eeecf-6e2a-4c67-8212-9cc910f58876'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:34.904187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71af895b4dc642d796aceb3c00785f43', 'request_id': 'req-e05eeecf-6e2a-4c67-8212-9cc910f58876'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:34.917582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] MFA Rules not processed for user `b62af126c45a4d0bb41a807c9f849a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:34.918808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:34.921443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] The token cache is being invalidate because project 71af895b4dc642d796aceb3c00785f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:34.921817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:34.922646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e05eeecf-6e2a-4c67-8212-9cc910f58876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:34.924904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1007/2039] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:34 2022] DELETE /identity/v3/projects/71af895b4dc642d796aceb3c00785f43 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:34.930801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0671a2-1b16-4602-87b3-04ad6538a717 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:34.931168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0671a2-1b16-4602-87b3-04ad6538a717 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:34.931712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0671a2-1b16-4602-87b3-04ad6538a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:34.955439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8e0671a2-1b16-4602-87b3-04ad6538a717 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:34.957046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e0671a2-1b16-4602-87b3-04ad6538a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.029958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1033/2040] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:35.040750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1008/2041] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:35.042814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.048990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.049536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.050500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.050500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.069991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:35.071046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.082607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1009/2042] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:35.086667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.098034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62ebf8-2f23-4a7c-b0e2-86ab53d49d78 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.106798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.108386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.108973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.109984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.111929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:35.112568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.120885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.145755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1010/2043] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:35.149395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.156129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8b821-206f-4963-9a7a-166e05c52e16 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.163786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.164703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.165158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.165724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.170728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952cdc-3608-4fb4-bfcf-1ef0a82a91a5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.176428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.177768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.178057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.178338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.179077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.181149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.202396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.209959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.241000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1034/2044] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:35.242140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.245897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.257936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1011/2045] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:35.262941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.278100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:35.297299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abefa55-7e38-4d15-897c-364b5a662271 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.331797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:35.407779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.409015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.409379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.409642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] PATH_INFO: `/v3/projects/39e32edabf344625bfc0bc7d603c7f08` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.411458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e32edabf344625bfc0bc7d603c7f08)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.415510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.423502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847febba-bbed-4d2e-ab31-07d43e404b8e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.429941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.430636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.431023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.431411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.432226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.434877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.457600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1012/2046] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:35.458611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.480529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e32edabf344625bfc0bc7d603c7f08', 'request_id': 'req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:35.486701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e32edabf344625bfc0bc7d603c7f08', 'request_id': 'req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:35.497506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e32edabf344625bfc0bc7d603c7f08', 'request_id': 'req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:35.513605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] The token cache is being invalidate because project 39e32edabf344625bfc0bc7d603c7f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:35.514454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:35.515205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:35.517243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1035/2047] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:35 2022] DELETE /identity/v3/projects/39e32edabf344625bfc0bc7d603c7f08 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:35.518063 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.519428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.535724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeecaf1-6ea8-4a4a-86a6-cde1b0f2ccd5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.603309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.603548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e9ce-fae8-4da1-8d85-ad63d64c0807 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.604063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.604237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.604516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.606331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.608436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.609146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.609445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.609719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.610474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.612280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01f603-689d-46d3-9b08-c45abef2bdbb admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.624337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1036/2048] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:35.626418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.626707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.626981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.647395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:35.648643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.657681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1037/2049] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:35.658479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.668553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7034491-cee6-413d-95aa-fcda5ae39fa0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.673484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.673712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.674143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.674427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.674702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.675114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.675842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.677115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce68a81-5128-46e8-b864-c557cb0307c1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.692818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1038/2050] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:35.693386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1013/2051] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:35.694430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.704117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.704469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.704749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.706364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a62e4-e15e-4f98-9b17-f9380674320b service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.711299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.712280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.712627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.712988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] PATH_INFO: `/v3/projects/f3ebfb7b15be44b18221339da6aaa395/users/357cb71be4ec4d619810db8e7ad51ae6/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.729739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ebfb7b15be44b18221339da6aaa395, user_id=357cb71be4ec4d619810db8e7ad51ae6, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.732640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e6cab-f375-452d-b36d-8ecb0ab9f766 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.737067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:35.738486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.748783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:35.754708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1039/2052] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:35.754879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1014/2053] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:35 2022] PUT /identity/v3/projects/f3ebfb7b15be44b18221339da6aaa395/users/357cb71be4ec4d619810db8e7ad51ae6/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:35.763398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.765840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:35.768159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.768774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.769054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.770642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267300d-5b93-4c53-947b-e9e66bccbac7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.825871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] MFA Rules not processed for user `357cb71be4ec4d619810db8e7ad51ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:35.828140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:35.866792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.867989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.868377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.868784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.869921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:35.870375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.872302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.897350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1040/2054] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:35.901718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.915422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14317e3-12a4-4f0b-a622-e7421f56f0fc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.926181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1015/2055] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:35.932014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.932923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.933281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.933462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.934402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.934558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.936965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.947282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b93e4d-bc86-4a53-bddf-db6b4cbc6227 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:35.953682 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:35.954754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:35.955038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:35.955310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:35.956068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:35.958145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:35.972863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1041/2056] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:35.977112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:35.991956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1016/2057] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:35.995872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.074887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c659-89e4-46dd-9d2c-cac5ea3ae1e7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.079283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb77ed0-db0b-4a58-a06f-1bc4a0e5f1ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.080479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.081280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.081700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.082074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.082845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.084000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.085064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.085403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.085629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.085910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.086779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.088869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.113489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1042/2058] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:36.118259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1017/2059] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:35 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:36.120997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.121123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.131394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50fdaa-abfe-4cd4-9f36-13fffb7285f1 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.131641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d92e-4cbc-4717-9de9-d866eb259819 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.136807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.137160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.137651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.137809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.138056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.138156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.138403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.138515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.139644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.140072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.141354 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.141896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.151945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1043/2060] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:36.157039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1018/2061] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:36.157258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.157739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.167155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3daec7-4610-4498-9304-923adffc68b0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.173810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.174480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.174603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb645c-a5a1-4825-844d-7458ffee47ed admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.174755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.175022 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.175780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.177669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.180186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.181078 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.181361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.181637 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] PATH_INFO: `/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b/users/a17746a9457f431ea510de3a755340b5/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.188902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1044/2062] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:36.192930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.201704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7959ddf5a64951bcc5f06bfbbd778b, user_id=a17746a9457f431ea510de3a755340b5, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.203375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e754-0733-44a5-8924-cad25267f8ec admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.204436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.208111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.209045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.209364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.209696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] PATH_INFO: `/v3/projects/b1518f4c37d740bfa6e30709ee6f714f/users/0a13ff2f65d847fbb797b550eb11e0e5/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.222766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1019/2063] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:36 2022] PUT /identity/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b/users/a17746a9457f431ea510de3a755340b5/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:36.224507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.226546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1518f4c37d740bfa6e30709ee6f714f, user_id=0a13ff2f65d847fbb797b550eb11e0e5, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.229707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f84e-d3d9-4217-b2e7-9776457c9a36 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.244390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1045/2064] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:36 2022] PUT /identity/v3/projects/b1518f4c37d740bfa6e30709ee6f714f/users/0a13ff2f65d847fbb797b550eb11e0e5/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:36.251802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:36.256699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.257230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.257595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.285830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] MFA Rules not processed for user `0a13ff2f65d847fbb797b550eb11e0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:36.287630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:36.290367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d748420-ecc4-46f3-b4df-16f2bb511861 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.296439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:36.354230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.354793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.355197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.355479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.356241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.357879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.368799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1020/2065] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:36.374089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.384408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1046/2066] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:36.386434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e7fb-e617-4220-8172-90a765595a11 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.399254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.399675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.400573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.401020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.401316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:36.401709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] PATH_INFO: `/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b/users/a17746a9457f431ea510de3a755340b5/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.404192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7959ddf5a64951bcc5f06bfbbd778b, user_id=a17746a9457f431ea510de3a755340b5, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.407784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9513c-cadc-4612-9e93-13a7ffde0422 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.419933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1021/2067] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:36 2022] PUT /identity/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b/users/a17746a9457f431ea510de3a755340b5/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:36.431301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.431643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.431927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.472347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] MFA Rules not processed for user `a17746a9457f431ea510de3a755340b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:36.473958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:36.498686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5da9-42f0-4a49-a0f8-129d7278b1de None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.567052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.567708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.567985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.568288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.589842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1022/2068] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:36.607982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.609356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:36.621105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f07b-0c48-42d7-9593-593ec4a0a4e2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.626162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.626806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.627088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.627358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.634887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.636406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.636961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.638391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.645756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1047/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:36.648182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1023/2070] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:36.701593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:36.710412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812e11-b8be-44a3-847a-9db244824409 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:36.714301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:36.714935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:36.715216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:36.715492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:36.735664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:36.776267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:36.777706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b27d9e-f2c5-4e26-ab92-2a35faa9f7f5 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:36.789097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1048/2071] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:40.068109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:40.069948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:40.109769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:40.157651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3b1-7c00-43eb-95fe-e957715523fa service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:40.163583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:40.164774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:40.165181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:40.165525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] PATH_INFO: `/v3/users/7c818560ac044f14919c16fe8c7b7e5c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:40.166713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c818560ac044f14919c16fe8c7b7e5c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:40.168709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:40.230474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c818560ac044f14919c16fe8c7b7e5c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.238778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c818560ac044f14919c16fe8c7b7e5c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.239815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c818560ac044f14919c16fe8c7b7e5c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.240465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c818560ac044f14919c16fe8c7b7e5c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.250499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c818560ac044f14919c16fe8c7b7e5c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.277088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1024/2072] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:40 2022] DELETE /identity/v3/users/7c818560ac044f14919c16fe8c7b7e5c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:40.281711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:40.282152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:40.282361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:40.306393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:40.307690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:40.382907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1049/2073] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:40.393440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:40.395255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:40.471837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7b62-f9f9-4b8e-a37d-c85144cdb2fa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:40.476193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:40.476776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:40.477058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:40.477364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:40.487975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:40.489448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:40.499669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1025/2074] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:40.802780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:40.804239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:40.845066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e312cdf-6cfd-4f18-8db8-3ed0ef789850 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:40.850687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:40.851885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:40.852451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:40.853153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] PATH_INFO: `/v3/projects/5139263e1e534152a2a3699769507bb7` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:40.855404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5139263e1e534152a2a3699769507bb7)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:40.858702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:40.925082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5139263e1e534152a2a3699769507bb7', 'request_id': 'req-26d10baf-73d9-4765-a5a8-cee0079f8c74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.933245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5139263e1e534152a2a3699769507bb7', 'request_id': 'req-26d10baf-73d9-4765-a5a8-cee0079f8c74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.943637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5139263e1e534152a2a3699769507bb7', 'request_id': 'req-26d10baf-73d9-4765-a5a8-cee0079f8c74'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.955623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] The token cache is being invalidate because project 5139263e1e534152a2a3699769507bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:40.956149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.956860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:40.958721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1050/2075] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:40 2022] DELETE /identity/v3/projects/5139263e1e534152a2a3699769507bb7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:40.962706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:40.973311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc4422-1409-4cb2-bf15-b4599f829b98 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:41.021928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:41.036919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:41.038464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.038817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.039187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] PATH_INFO: `/v3/users/b62af126c45a4d0bb41a807c9f849a82` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.040616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62af126c45a4d0bb41a807c9f849a82)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:41.042739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:41.096506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62af126c45a4d0bb41a807c9f849a82'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.107127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62af126c45a4d0bb41a807c9f849a82'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.107920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62af126c45a4d0bb41a807c9f849a82'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.109010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62af126c45a4d0bb41a807c9f849a82'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.119534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62af126c45a4d0bb41a807c9f849a82'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.142425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1026/2076] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:40 2022] DELETE /identity/v3/users/b62af126c45a4d0bb41a807c9f849a82 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:41.484639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:41.486539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.507114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10baf-73d9-4765-a5a8-cee0079f8c74 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:41.507374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:41.509084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.558498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:41.580486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:41.581979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.582317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.582523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] PATH_INFO: `/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.585411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c223c3c64ae4e2281ed6332ac1023c0)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:41.587348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:41.593426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f59e-1e83-4c2e-8a7a-ddf3ab653eff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:41.598266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:41.599139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.599408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.599710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] PATH_INFO: `/v3/users/357cb71be4ec4d619810db8e7ad51ae6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.601050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357cb71be4ec4d619810db8e7ad51ae6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:41.603280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:41.644280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c223c3c64ae4e2281ed6332ac1023c0', 'request_id': 'req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.650642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c223c3c64ae4e2281ed6332ac1023c0', 'request_id': 'req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.660609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357cb71be4ec4d619810db8e7ad51ae6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.661820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c223c3c64ae4e2281ed6332ac1023c0', 'request_id': 'req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.668971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357cb71be4ec4d619810db8e7ad51ae6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.669881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357cb71be4ec4d619810db8e7ad51ae6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.670687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357cb71be4ec4d619810db8e7ad51ae6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.676156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] The token cache is being invalidate because project 8c223c3c64ae4e2281ed6332ac1023c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:41.676551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.677321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c5d3a3b4-7dac-4e40-9dea-c6247b86488c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.679516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1051/2077] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:41 2022] DELETE /identity/v3/projects/8c223c3c64ae4e2281ed6332ac1023c0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:41.682015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-040a9f70-a175-475d-b620-3e4175bc7b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357cb71be4ec4d619810db8e7ad51ae6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:41.684574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882e21-8256-43b8-9e6a-6588cd0ac811 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.685009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882e21-8256-43b8-9e6a-6588cd0ac811 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.685196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882e21-8256-43b8-9e6a-6588cd0ac811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.688270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:41.708714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-05882e21-8256-43b8-9e6a-6588cd0ac811 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:41.709914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-05882e21-8256-43b8-9e6a-6588cd0ac811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.713238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1027/2078] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:41 2022] DELETE /identity/v3/users/357cb71be4ec4d619810db8e7ad51ae6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:41.717862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.718153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.718431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.738554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:41.739976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.792054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1052/2079] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:41.800956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.801282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.801498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.823078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:41.825252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.851342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1028/2080] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:41.852891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:41.854479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:41.944282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1053/2081] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:41.950278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:41.965307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0096f6-8263-4aa5-a18b-adb8ef559973 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:41.970905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:41.971738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.972150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.972532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.973370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:41.973786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:41.975508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:41.978723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5392cc7-f2c7-4373-8ec1-0e0433fb2808 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:41.982562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:41.983747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:41.984060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:41.984321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:41.986145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:41.991168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1054/2082] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:41.995570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:41.995963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:41.997456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.008250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b909-ed96-4010-981c-df76229e7b02 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.009277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1029/2083] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:42.013775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.014570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.014972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.015349 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.016200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.018345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.064915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.065155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1055/2084] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:41 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:42.075950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374b51f-ebc1-4e36-bb61-c95bb230e162 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.152376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.153378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.153761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.154240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.155398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.157580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.188882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1030/2085] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:42 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:42.192848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.205834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157627-7af4-47b9-bff5-bd04f103948d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.212568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.213386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.213767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.214147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.215018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.216790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.238399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.246974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1056/2086] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:42.253712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a1983-c42a-4b49-a731-d1d269242f41 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.261686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.262436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.262869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.264279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.265394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.267151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.283456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.294580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1031/2087] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:42.294769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58fba-dc5a-464d-8dda-fcd190e9dff2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.302126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.304006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.304589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.305539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] PATH_INFO: `/v3/projects/19d6929a7da44c39ada7e9dd24b9183f/users/3e58ffd0f69448a8963470fd33e8e86b/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.330997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d6929a7da44c39ada7e9dd24b9183f, user_id=3e58ffd0f69448a8963470fd33e8e86b, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.334346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafaa6-601d-48ac-a53c-db6ce2f5ee82 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.348851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.352170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.374216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1057/2088] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:42 2022] PUT /identity/v3/projects/19d6929a7da44c39ada7e9dd24b9183f/users/3e58ffd0f69448a8963470fd33e8e86b/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:42.384581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.384877 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.385153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.390964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c29b3-412d-45f6-a251-33c99d37b123 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.409081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:42.432705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] MFA Rules not processed for user `3e58ffd0f69448a8963470fd33e8e86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:42.433917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.542342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1058/2089] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:42.544271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.546742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.556968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.558278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.558574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.558857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] PATH_INFO: `/v3/users/0a13ff2f65d847fbb797b550eb11e0e5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.560284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a13ff2f65d847fbb797b550eb11e0e5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.562717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.638106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a13ff2f65d847fbb797b550eb11e0e5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.647444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a13ff2f65d847fbb797b550eb11e0e5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.648251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a13ff2f65d847fbb797b550eb11e0e5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.648887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a13ff2f65d847fbb797b550eb11e0e5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.656154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee59a9-282a-4777-a625-244fd2bf4248 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.659939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a13ff2f65d847fbb797b550eb11e0e5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.669539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.671392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.671689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.671982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] PATH_INFO: `/v3/projects/f3ebfb7b15be44b18221339da6aaa395` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.673693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ebfb7b15be44b18221339da6aaa395)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.676864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.685353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1032/2090] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:42 2022] DELETE /identity/v3/users/0a13ff2f65d847fbb797b550eb11e0e5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:42.689305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.691238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.734936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:42.748578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ebfb7b15be44b18221339da6aaa395', 'request_id': 'req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.756258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ebfb7b15be44b18221339da6aaa395', 'request_id': 'req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.768256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ebfb7b15be44b18221339da6aaa395', 'request_id': 'req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.785613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] The token cache is being invalidate because project f3ebfb7b15be44b18221339da6aaa395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:42.785910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.787196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0f41f6bd-fb0b-4e0e-90a6-dfd278fb1e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.789188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1059/2091] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:42 2022] DELETE /identity/v3/projects/f3ebfb7b15be44b18221339da6aaa395 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:42.794064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.794621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.795032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.815138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:42.816443 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.824807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d476b4-3235-4ec9-bcad-76b13538fc2c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.866984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:42.905075 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.906237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.906525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.907420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1060/2092] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:42.908231 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.909965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.911594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.912349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.914381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dbbb-0324-4ce9-89b6-578c1d90f7b2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.922819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bf601-6ce3-41a3-9394-30e578e53238 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:42.927919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:42.929024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.929375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.929721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] PATH_INFO: `/v3/users/a17746a9457f431ea510de3a755340b5` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.931023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17746a9457f431ea510de3a755340b5)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:42.933239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:42.952991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1033/2093] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:42 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:42.954395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:42.954680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:42.954950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:42.956445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1034/2094] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:29:42.956885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:42.958592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:42.994518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17746a9457f431ea510de3a755340b5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:42.995146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17746a9457f431ea510de3a755340b5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.004086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17746a9457f431ea510de3a755340b5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.018014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17746a9457f431ea510de3a755340b5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.018675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17746a9457f431ea510de3a755340b5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.033880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf351e3-a13d-4572-b8ba-9cbf2b91cd82 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.037639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.038276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.038410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1061/2095] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:42 2022] DELETE /identity/v3/users/a17746a9457f431ea510de3a755340b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:43.038605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.038885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.039125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.040459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.042909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.085221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:43.116702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab4c0-f09c-46fd-877f-b9c53e67220d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.121810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.122872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.122989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.123941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] PATH_INFO: `/v3/users/3457e2d9157a451ba09567666d577154` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.125256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3457e2d9157a451ba09567666d577154)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.127319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.129342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.130984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.143574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1035/2096] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:43.144427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.145995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.159789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5febc7a-35ae-4739-b5a5-f2f9c985ae80 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.166456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.167131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.167409 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.167687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.168455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.170609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4a0d3-3619-42d4-915d-8c4091a50192 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.183544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3457e2d9157a451ba09567666d577154'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.184453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3457e2d9157a451ba09567666d577154'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.192386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3457e2d9157a451ba09567666d577154'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.197269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1036/2097] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:43 2022] POST /identity/v3/users => generated 301 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:43.197269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.197269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.197269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.204839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3457e2d9157a451ba09567666d577154'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.205621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3457e2d9157a451ba09567666d577154'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.219054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] MFA Rules not processed for user `c3da23fe1a18462896bc021aa76561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:43.221165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.228098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1062/2098] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:43 2022] DELETE /identity/v3/users/3457e2d9157a451ba09567666d577154 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:43.229059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.231875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.295174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:43.329568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1037/2099] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:43.347592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.350141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.352298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6005da-9448-4f3d-a9d9-574588b94f9b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.359701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.360553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.360900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.361241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.362050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.365575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.370774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a78fd-8d6f-419f-9756-0ef7ca34705d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.381725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1063/2100] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:43.385907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.410586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7d0b-2be4-450a-badf-a3058cb0e534 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.418477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.419503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.419616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.420652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] PATH_INFO: `/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8/users/18b95f6d75ac466c985c8dc0987860ca/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.453519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6338744f0d9a4268b4fb5ae62460b4e8, user_id=18b95f6d75ac466c985c8dc0987860ca, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.458204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.468375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.469008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.469296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.469568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.480233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.482034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.485497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1064/2101] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:43 2022] PUT /identity/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8/users/18b95f6d75ac466c985c8dc0987860ca/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:43.486670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.488494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.495170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1038/2102] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:43.496044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.507478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e45b5-cf1c-4727-9c4e-9c375a1d918b service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.539107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:43.583570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.584266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.584864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.585155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.586499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.588349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.591066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023514a-b903-4769-9971-b9ddf52aa72a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.596789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.597768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.598125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.598473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] PATH_INFO: `/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.599683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1039/2103] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:43.599806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7959ddf5a64951bcc5f06bfbbd778b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.601862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.606355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.617974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3d8c-33c7-41c4-9c2e-1cddfdd9260b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.626864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.627791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.628116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.629504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] PATH_INFO: `/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8/users/18b95f6d75ac466c985c8dc0987860ca/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.633064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6338744f0d9a4268b4fb5ae62460b4e8, user_id=18b95f6d75ac466c985c8dc0987860ca, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.636251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.655581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1040/2104] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:43 2022] PUT /identity/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8/users/18b95f6d75ac466c985c8dc0987860ca/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:43.660200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7959ddf5a64951bcc5f06bfbbd778b', 'request_id': 'req-25cd88f0-3d7f-4c48-a525-36f7c108e125'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.661801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.668067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.673038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7959ddf5a64951bcc5f06bfbbd778b', 'request_id': 'req-25cd88f0-3d7f-4c48-a525-36f7c108e125'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.683418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7959ddf5a64951bcc5f06bfbbd778b', 'request_id': 'req-25cd88f0-3d7f-4c48-a525-36f7c108e125'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.696080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] The token cache is being invalidate because project cd7959ddf5a64951bcc5f06bfbbd778b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:43.696328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.697475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-25cd88f0-3d7f-4c48-a525-36f7c108e125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.705619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1065/2105] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:43 2022] DELETE /identity/v3/projects/cd7959ddf5a64951bcc5f06bfbbd778b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:43.706960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.707248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.707523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.735593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] MFA Rules not processed for user `18b95f6d75ac466c985c8dc0987860ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:43.736843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.743180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e94d-1636-4c90-9803-f4ff5c8d0f1b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.747846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.748764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.749045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.749319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] PATH_INFO: `/v3/projects/449b696e1a994626a5854edbcd9f7649` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.750499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] RBAC: Authorizing `identity:delete_project(project_id=449b696e1a994626a5854edbcd9f7649)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.752444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.753931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:43.803764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449b696e1a994626a5854edbcd9f7649', 'request_id': 'req-a54741e4-39d3-4246-b5ef-af1dede4016a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.807698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1066/2106] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:43.808681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.810162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.814507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449b696e1a994626a5854edbcd9f7649', 'request_id': 'req-a54741e4-39d3-4246-b5ef-af1dede4016a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.821978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449b696e1a994626a5854edbcd9f7649', 'request_id': 'req-a54741e4-39d3-4246-b5ef-af1dede4016a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.824060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f421-821d-4763-99b5-d21b34854dbe None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:43.833233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] The token cache is being invalidate because project 449b696e1a994626a5854edbcd9f7649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:43.833513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.834169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a54741e4-39d3-4246-b5ef-af1dede4016a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.835803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1041/2107] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:43 2022] DELETE /identity/v3/projects/449b696e1a994626a5854edbcd9f7649 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:43.837164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.837453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.837722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.859085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:43.860374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.869839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:43.901565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:43.902496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:43.902771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:43.903072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] PATH_INFO: `/v3/projects/b1518f4c37d740bfa6e30709ee6f714f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:43.905347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1518f4c37d740bfa6e30709ee6f714f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:43.907281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:43.929296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1042/2108] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:43.929947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:43.931271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:43.969535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1518f4c37d740bfa6e30709ee6f714f', 'request_id': 'req-963190bc-3870-4356-9f05-7077cbf37138'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.975847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1518f4c37d740bfa6e30709ee6f714f', 'request_id': 'req-963190bc-3870-4356-9f05-7077cbf37138'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.985692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1518f4c37d740bfa6e30709ee6f714f', 'request_id': 'req-963190bc-3870-4356-9f05-7077cbf37138'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.997048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] The token cache is being invalidate because project b1518f4c37d740bfa6e30709ee6f714f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:43.997329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.997962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-963190bc-3870-4356-9f05-7077cbf37138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:43.999565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1067/2109] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:43 2022] DELETE /identity/v3/projects/b1518f4c37d740bfa6e30709ee6f714f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:44.000812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd944-deed-4dd3-946d-b5477133d453 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.001107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd944-deed-4dd3-946d-b5477133d453 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.001355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd944-deed-4dd3-946d-b5477133d453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.002100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ec52-dcb9-4ab8-88a7-5a9f764b7e45 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.019212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a04bd944-deed-4dd3-946d-b5477133d453 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.020213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a04bd944-deed-4dd3-946d-b5477133d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.051138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:44.057278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.058110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.058621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.060585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.063088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.093107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1068/2110] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.094570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931455-84cc-4a6a-a6c1-716eaffcfc8d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.094922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931455-84cc-4a6a-a6c1-716eaffcfc8d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.095270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931455-84cc-4a6a-a6c1-716eaffcfc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.112927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a0931455-84cc-4a6a-a6c1-716eaffcfc8d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.114209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a0931455-84cc-4a6a-a6c1-716eaffcfc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.122279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1069/2111] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.123505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.123792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.124191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.129914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.131369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e4ec-5970-4068-98ee-0270f0c01f7e service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.142399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.143656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.146575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1043/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:44.147875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065433-0ca8-458f-8814-8e2880660569 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.148158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065433-0ca8-458f-8814-8e2880660569 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.148438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065433-0ca8-458f-8814-8e2880660569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.158298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1070/2113] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.159240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.166104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d1065433-0ca8-458f-8814-8e2880660569 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.167309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d1065433-0ca8-458f-8814-8e2880660569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.170988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c67d-b331-49ea-8d3e-0393eb0908ff None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.175999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.179617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1044/2114] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.179960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.179960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.179960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.180215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.180215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.180344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:44.180420 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.180491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.180491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.200631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1071/2115] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:44.200631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.200857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.200857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.216114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a22f6-a971-462f-9e3d-57bc1e7b8c32 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.216265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1045/2116] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.216873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.220746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.221541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.221860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.222111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.222840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:44.223144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.224793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.227034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff053-3401-4d91-afc1-8478dd2c2348 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.231934 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.233145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.233428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.233703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.234400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.237141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.243056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1072/2117] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:44.243056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.257205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4084-3f0c-4ed6-9a7f-2ca552d0c69d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.262830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.263571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.263875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.264181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.264971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:44.265340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.267034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.272671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1046/2118] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.273476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.282082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1073/2119] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:44.282865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.294236 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0216d7-dda5-4df5-a687-eb686db8fa78 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.317694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:44.346113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e2abb-3b25-4d28-93b4-2b5a28f92e3c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.350976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.351620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.351897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.352207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.353154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.355051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.360718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.361384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.361669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.361947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.362629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.364628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.386097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1047/2120] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.386097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.387600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1074/2121] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.388579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.390238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.401966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fba0c-5ecc-4912-bf9c-75022d1e0c30 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.431645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:44.450493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c4901-2d93-4b43-ad95-8d91ba208cf3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.455314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.455923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.456234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.456507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.457192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.459131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.460658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.461529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.461810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.462203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] PATH_INFO: `/v3/users/3e58ffd0f69448a8963470fd33e8e86b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.463417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e58ffd0f69448a8963470fd33e8e86b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.465384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.486644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1048/2122] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.487753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.516765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e58ffd0f69448a8963470fd33e8e86b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:44.517594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e58ffd0f69448a8963470fd33e8e86b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:44.524519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e58ffd0f69448a8963470fd33e8e86b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:44.532801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e58ffd0f69448a8963470fd33e8e86b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:44.533564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e58ffd0f69448a8963470fd33e8e86b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:44.553418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1075/2123] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:44 2022] DELETE /identity/v3/users/3e58ffd0f69448a8963470fd33e8e86b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:44.554662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fee8b-94c8-4bf0-9014-d01046cc1316 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.557049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.558628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.589930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:44.612651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.613479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.613782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.614053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.614731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.616683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.625584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928f8a-6ba8-4aa9-b35d-1f89dda93472 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.630906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.631701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.632005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.632512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.633161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.634830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30856259-6cdf-4aad-a463-246808722f1b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.637129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1049/2124] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.637927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.639498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.648790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1076/2125] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.648790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.648790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.648790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.654300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0cdb-a786-436c-b7f2-da9838fb4587 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.659377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.660039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.660327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.660604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.661278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.663195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.665803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:44.666982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.675446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1077/2126] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:44.676273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.677521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.691845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1050/2127] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:44.692034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158e32a-398e-43ba-bc14-5ad85e732720 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.693042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.694389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.695031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.695307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.695578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.696329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.697917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.703275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faef47-5e9d-4f0f-8ffb-36eb737ba68f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.707810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.708225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1078/2128] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.708483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.708760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.709033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.709141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.709856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.711880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.712244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:44.723148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1051/2129] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.723896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.735927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8505-31dd-4ef0-8a56-633d722dde42 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.740464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.741166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.741447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.741720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.742423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.744220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.754383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1052/2130] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.755371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.765359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97308f4-73a1-4bc6-80c8-5018bf5a518d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.769907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.770531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.770811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.770904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040f66-65c3-4897-89f9-ac633b5e9ecb admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.771080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.771784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.773490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.774579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.775222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.776169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.776458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.784773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1053/2131] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.785691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.789492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.791141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.797282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037b4b-51dc-487b-bc9a-c906d7b4a993 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.801711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1079/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:44.801826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.802504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.802629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.802921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.803179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] PATH_INFO: `/v3/projects/f06258b1f38944b481588cd591d1a3c5/users/8e19b0dccb444c8795d191d046648206/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.812508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d86fc-3242-4052-b7f2-1a3284802e06 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.817388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.818054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.818418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.818594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.819594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.820100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06258b1f38944b481588cd591d1a3c5, user_id=8e19b0dccb444c8795d191d046648206, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.820959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.823108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.826092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:44.835804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1080/2133] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:44.835804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.845202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82305-4697-4437-b5f2-bba185cdfeb3 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.846751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1054/2134] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:44 2022] PUT /identity/v3/projects/f06258b1f38944b481588cd591d1a3c5/users/8e19b0dccb444c8795d191d046648206/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:44.847641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:44.925623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf018-c23e-4f5c-8db1-5e78f4e90cda admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:44.928071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.929095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.929378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.929656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] PATH_INFO: `/v3/projects/26d62c47ada844ab9d6c98e1477e4582/users/0ee2ea9e5d3d43138971f800369fad83/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.931252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:44.932281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.932566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.932991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] PATH_INFO: `/v3/projects/0e133b9c10054c8d84f06ebcd769685c/users/26a11e98051b4bec84b6a75eafceb7a1/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.948725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d62c47ada844ab9d6c98e1477e4582, user_id=0ee2ea9e5d3d43138971f800369fad83, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.952326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0cdc0-e88a-4b06-9248-d1100e432529 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.957002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e133b9c10054c8d84f06ebcd769685c, user_id=26a11e98051b4bec84b6a75eafceb7a1, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:44.959730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ad35-95d3-4375-bd0e-42cf6101dbf6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:44.976136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1055/2135] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:44 2022] PUT /identity/v3/projects/0e133b9c10054c8d84f06ebcd769685c/users/26a11e98051b4bec84b6a75eafceb7a1/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:44.977143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f905d-08a5-4740-9b99-7ff24f586f01 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.977436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f905d-08a5-4740-9b99-7ff24f586f01 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.977973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f905d-08a5-4740-9b99-7ff24f586f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:44.981773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1081/2136] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:44 2022] PUT /identity/v3/projects/26d62c47ada844ab9d6c98e1477e4582/users/0ee2ea9e5d3d43138971f800369fad83/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:44.986528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:44.986820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:44.987099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.010181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-371f905d-08a5-4740-9b99-7ff24f586f01 None None] MFA Rules not processed for user `8e19b0dccb444c8795d191d046648206`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:45.011478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-371f905d-08a5-4740-9b99-7ff24f586f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.016795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] MFA Rules not processed for user `26a11e98051b4bec84b6a75eafceb7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:45.017990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.030074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:45.096614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1056/2137] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:45.099834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.100165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.100571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.106087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1082/2138] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:45.107296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:45.110041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.135337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:45.137032 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.176359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353b579-0d05-4f1e-ad52-fcb081761190 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:45.180544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:45.181184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.181463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.181734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.191133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:45.192599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:45.200423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1057/2139] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:45.201928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:45.202037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1083/2140] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:45.203201 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.213162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:45.214578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.219772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:45.239563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57910b-7a80-48db-aa67-4eb172cccbcd service glance] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:45.245729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:45.246982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.247437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.247720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] PATH_INFO: `/v3/projects/19d6929a7da44c39ada7e9dd24b9183f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.250621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d6929a7da44c39ada7e9dd24b9183f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:45.252602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:45.275714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637eaf7-3325-4855-9841-bcf348c1b107 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:45.280577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:45.281224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.281990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.282292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.292786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:45.294249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:45.303596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1058/2141] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:45.304693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:45.306336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.312793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d6929a7da44c39ada7e9dd24b9183f', 'request_id': 'req-3f0b2879-c1ca-4c86-b286-37ae9972d75d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.326082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d6929a7da44c39ada7e9dd24b9183f', 'request_id': 'req-3f0b2879-c1ca-4c86-b286-37ae9972d75d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.344730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d6929a7da44c39ada7e9dd24b9183f', 'request_id': 'req-3f0b2879-c1ca-4c86-b286-37ae9972d75d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.361996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] The token cache is being invalidate because project 19d6929a7da44c39ada7e9dd24b9183f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:45.362755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.363529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.366447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1084/2142] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:45 2022] DELETE /identity/v3/projects/19d6929a7da44c39ada7e9dd24b9183f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:45.371006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:45.379366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.393651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa38c1a-89c1-4529-bf29-c1384c3c402b service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:45.437953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:45.466312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:45.469089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.469525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.469833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.472282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:45.477028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b2879-c1ca-4c86-b286-37ae9972d75d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:45.490149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:45.491226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:45.491737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:45.491860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:45.492590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] PATH_INFO: `/v3/users/18b95f6d75ac466c985c8dc0987860ca` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:45.493662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:45.494612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b95f6d75ac466c985c8dc0987860ca)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:45.497598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:45.508232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1059/2143] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:45.571289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b95f6d75ac466c985c8dc0987860ca'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.572985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b95f6d75ac466c985c8dc0987860ca'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.590366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b95f6d75ac466c985c8dc0987860ca'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.601905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b95f6d75ac466c985c8dc0987860ca'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.603118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e415632e-8f95-4b72-8728-2a333095a17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b95f6d75ac466c985c8dc0987860ca'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:45.629312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1085/2144] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:45 2022] DELETE /identity/v3/users/18b95f6d75ac466c985c8dc0987860ca => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:46.009591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.030039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb696-9165-494a-89c4-627c84cf5f02 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.098150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.099188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.099541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.099750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] PATH_INFO: `/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.101290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6338744f0d9a4268b4fb5ae62460b4e8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.103861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.115397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:46.154096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6338744f0d9a4268b4fb5ae62460b4e8', 'request_id': 'req-14f0e806-5bf1-468d-9712-67daa29a18cb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:46.162882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6338744f0d9a4268b4fb5ae62460b4e8', 'request_id': 'req-14f0e806-5bf1-468d-9712-67daa29a18cb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:46.169371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6338744f0d9a4268b4fb5ae62460b4e8', 'request_id': 'req-14f0e806-5bf1-468d-9712-67daa29a18cb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:46.191455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] The token cache is being invalidate because project 6338744f0d9a4268b4fb5ae62460b4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:46.191752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:46.192482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-14f0e806-5bf1-468d-9712-67daa29a18cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:46.198989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1060/2145] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:46 2022] DELETE /identity/v3/projects/6338744f0d9a4268b4fb5ae62460b4e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:46.200769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.201369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.201779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.235437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:46.236690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:46.339250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.339853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.340003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.344832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1086/2146] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:46.384491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:46.385742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:46.394813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1061/2147] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:46.398775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.410266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e41a-4ff3-4077-b35b-3f9a3b11d32c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.416855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.417572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.417871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.418165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.419027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:46.419298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.421283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.445619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1087/2148] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:46.449417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.459661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc856cc-1889-4b9d-9112-26ceea7a68be None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.464717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.465374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.465653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.465920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.466696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.469472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.501589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1062/2149] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:46 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:46.505729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.518969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e108-2231-4bf9-85ad-3ec5f4676800 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.578857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:46.601490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.603152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.603951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.604529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.605495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.607376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.642697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.648260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1088/2150] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:46 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:46.662563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43ba6-b7ea-443c-82bb-57d5650cba24 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.668611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.669614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.670353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.670676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.671615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.674331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.689111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1063/2151] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:46.693233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.710763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d7fa-6379-4f84-908a-f9e2920e8401 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.719222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.719842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.720267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.720514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.721314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.722862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f90e8b-6ed8-4219-b97a-dc9c469c2909 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.737438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1089/2152] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:46.741113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:46.766228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0eff-6224-41bd-94c7-8ff7311db847 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:46.771024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:46.772598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.772879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.773153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] PATH_INFO: `/v3/projects/8d428eb3291f44c691911701f605c7ca/users/7e5b8e3e889049488dad3a81c85c49ce/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.808080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d428eb3291f44c691911701f605c7ca, user_id=7e5b8e3e889049488dad3a81c85c49ce, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:46.809782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:46.843041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1064/2153] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:46 2022] PUT /identity/v3/projects/8d428eb3291f44c691911701f605c7ca/users/7e5b8e3e889049488dad3a81c85c49ce/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:46.844757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:46.845035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:46.845379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:46.907316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] MFA Rules not processed for user `7e5b8e3e889049488dad3a81c85c49ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:46.912480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:47.037491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1090/2154] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:47.048576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.145274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd14e61-4d80-4528-8b98-0b4b2784b024 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.151670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.152373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.153293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.153579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.154375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.158055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.198979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1065/2155] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:47 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:47.203088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.221847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9c93-349d-4e63-92b9-4ff079056713 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.291043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.291729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.292083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.292359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.293067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.295798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.320054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1091/2156] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:47 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:47.323669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.335476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3a0f4-fd43-4a53-b81e-98d214b65729 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.341723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.342429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.342720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.342997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.343899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.345617 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.362200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1066/2157] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:47.366558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.390908 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012d76-cf5c-460b-b085-f63342922ff3 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.396256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.396979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.397267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.397551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.398283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.405371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be243aa-48a9-4b80-87d1-fbc26ed72c71 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.422034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1092/2158] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:47.425974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.436649 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30f83-dfd9-4e6c-a173-009d513401de admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.445149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.445149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.445455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.445808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] PATH_INFO: `/v3/projects/5dc799010f734666a7da147fc64acebc/users/eb41e1ab087c417ebc5c098ff2a75fb0/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.450533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:47.485911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc799010f734666a7da147fc64acebc, user_id=eb41e1ab087c417ebc5c098ff2a75fb0, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.490389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.506690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1067/2159] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:47 2022] PUT /identity/v3/projects/5dc799010f734666a7da147fc64acebc/users/eb41e1ab087c417ebc5c098ff2a75fb0/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:29:47.517718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.518011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.518288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.573048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] MFA Rules not processed for user `eb41e1ab087c417ebc5c098ff2a75fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:47.574287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:47.596264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:47.649036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1093/2160] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:47.653741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.722290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9395-9b2c-4e7d-a018-72e57dc1faf2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.729148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.730127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.730612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.731044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.731930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.734842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.767920 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1068/2161] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:47 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:47.769168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.781546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b059-d170-46c3-a49a-2c0499694c53 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.861630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.862310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.862599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.862875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.863848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.865858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.892481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1094/2162] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:47 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:47.895695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.908177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd5b1-6c0b-4b29-968a-f75b54df18dd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.914933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.915855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.915968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.916279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:47.916985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:47.918622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:47.945505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1069/2163] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:47.946733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:47.962951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e10-3958-4841-b6bf-11aee6b20f14 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:47.983005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:47.984296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:47.984647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:47.984991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] PATH_INFO: `/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5/users/e69dc432821041dfbb3e5aa49004a6b4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.004615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2182f6406aa49b3afee49c9ba71e3f5, user_id=e69dc432821041dfbb3e5aa49004a6b4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:48.013376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:48.039992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1095/2164] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:47 2022] PUT /identity/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5/users/e69dc432821041dfbb3e5aa49004a6b4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:48.040913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:48.067422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f453-cf69-4614-a630-0ee6e83d7f0b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:48.200563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:48.202179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:48.202179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:48.202519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.203357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:48.205257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f2f8-ef1d-47fd-b5a2-78c20afe3b76 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:48.221972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1070/2165] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:48.225393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:48.240285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb22c19-9165-4fd7-a487-60642ec6991c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:48.252493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:48.253428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:48.253820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:48.257087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] PATH_INFO: `/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5/users/e69dc432821041dfbb3e5aa49004a6b4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.263228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2182f6406aa49b3afee49c9ba71e3f5, user_id=e69dc432821041dfbb3e5aa49004a6b4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:48.271176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:48.298655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1096/2166] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:48 2022] PUT /identity/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5/users/e69dc432821041dfbb3e5aa49004a6b4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:48.314592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:48.317792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:48.319440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.371944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] MFA Rules not processed for user `e69dc432821041dfbb3e5aa49004a6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:48.374050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:48.446493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:48.481923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1071/2167] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:48.493920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:48.501550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:48.568140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff0d1-9219-4757-bc5e-79523393392c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:48.571828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:48.572513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:48.572794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:48.573069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.584901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:48.586499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8888d6-ed6a-4544-88d5-e99c91d391fa service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:48.603497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1097/2168] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:48.647585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:48.649096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:48.668061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a23d0-c69a-47cb-8d63-65c8d456693a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:48.678026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:48.679778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:48.680514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:48.681852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:48.779620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:48.784251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd11f3-135b-4288-adcb-f91d5561f982 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:48.812092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1072/2169] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:29:50.574129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:50.574711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:50.574711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:50.621213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] MFA Rules not processed for user `0ee2ea9e5d3d43138971f800369fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:50.622560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:50.627821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:50.747552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1098/2170] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:50.759447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca5c9-62dc-46eb-a553-2776304c305d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:50.759974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca5c9-62dc-46eb-a553-2776304c305d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:50.759974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca5c9-62dc-46eb-a553-2776304c305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:50.780039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-336ca5c9-62dc-46eb-a553-2776304c305d None None] MFA Rules not processed for user `0ee2ea9e5d3d43138971f800369fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:50.781262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-336ca5c9-62dc-46eb-a553-2776304c305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:50.791165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1073/2171] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:50.805685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:50.807287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:50.907951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21239775-8c62-451f-b7db-65fd30df50ec None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:50.916071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:50.916741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:50.917016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:50.917290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:50.926716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:50.928371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:50.941389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1099/2172] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:51.641895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204711-34b7-4f9a-8ff9-ca342bca5fe6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:51.642565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204711-34b7-4f9a-8ff9-ca342bca5fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:51.642922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204711-34b7-4f9a-8ff9-ca342bca5fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:51.672400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8e204711-34b7-4f9a-8ff9-ca342bca5fe6 None None] MFA Rules not processed for user `0ee2ea9e5d3d43138971f800369fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:51.674046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e204711-34b7-4f9a-8ff9-ca342bca5fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:51.694684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1074/2173] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:52.105140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:52.195591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93463-eadc-4d8a-878f-d0f98e1f088a service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:52.201263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:52.202308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:52.203002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:52.203486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] PATH_INFO: `/v3/users/7e5b8e3e889049488dad3a81c85c49ce` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:52.205281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5b8e3e889049488dad3a81c85c49ce)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:52.207728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:52.345329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:52.365735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5b8e3e889049488dad3a81c85c49ce'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:52.366537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5b8e3e889049488dad3a81c85c49ce'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:52.385406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5b8e3e889049488dad3a81c85c49ce'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:52.398192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5b8e3e889049488dad3a81c85c49ce'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:52.400107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5b8e3e889049488dad3a81c85c49ce'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:52.446809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1100/2174] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:52 2022] DELETE /identity/v3/users/7e5b8e3e889049488dad3a81c85c49ce => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:52.452951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:52.453490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:52.453837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:52.482223 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:52.484177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:52.573393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1075/2175] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:52.584716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:52.586480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:52.689715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0e00b-11ca-4264-9116-40ab8ef8ca49 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:52.696597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:52.697244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:52.697903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:52.704505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:52.724292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:52.727020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:52.740121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1101/2176] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:53.277024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:53.278607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:53.304095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba6155-eb65-4346-9374-e5c10c8ecf8e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:53.316516 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:53.317724 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:53.318220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:53.319052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] PATH_INFO: `/v3/projects/8d428eb3291f44c691911701f605c7ca` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:53.320824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d428eb3291f44c691911701f605c7ca)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:53.323380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:53.445290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d428eb3291f44c691911701f605c7ca', 'request_id': 'req-fc431354-7cb2-41d3-9ae7-42552892a149'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.469955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d428eb3291f44c691911701f605c7ca', 'request_id': 'req-fc431354-7cb2-41d3-9ae7-42552892a149'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.476160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:53.479416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d428eb3291f44c691911701f605c7ca', 'request_id': 'req-fc431354-7cb2-41d3-9ae7-42552892a149'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.504360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] The token cache is being invalidate because project 8d428eb3291f44c691911701f605c7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:53.504796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.506108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.511506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1076/2177] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:53 2022] DELETE /identity/v3/projects/8d428eb3291f44c691911701f605c7ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:53.512384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:53.526585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba7ac-2f49-4051-b86f-7ea226d819e3 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:53.678991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:53.679906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:53.680224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:53.680499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] PATH_INFO: `/v3/users/eb41e1ab087c417ebc5c098ff2a75fb0` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:53.685915 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb41e1ab087c417ebc5c098ff2a75fb0)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:53.688300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:53.758904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb41e1ab087c417ebc5c098ff2a75fb0'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.760475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb41e1ab087c417ebc5c098ff2a75fb0'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.770489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:53.774178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb41e1ab087c417ebc5c098ff2a75fb0'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.795747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb41e1ab087c417ebc5c098ff2a75fb0'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.796818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb41e1ab087c417ebc5c098ff2a75fb0'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:53.840441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1102/2178] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:53 2022] DELETE /identity/v3/users/eb41e1ab087c417ebc5c098ff2a75fb0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:54.360729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:54.365446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:54.403673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431354-7cb2-41d3-9ae7-42552892a149 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:54.648296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:54.649196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:54.649482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:54.649763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] PATH_INFO: `/v3/projects/5dc799010f734666a7da147fc64acebc` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:54.655149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc799010f734666a7da147fc64acebc)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:54.657413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:54.794242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc799010f734666a7da147fc64acebc', 'request_id': 'req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:54.814263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc799010f734666a7da147fc64acebc', 'request_id': 'req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:54.839671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc799010f734666a7da147fc64acebc', 'request_id': 'req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:54.875377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] The token cache is being invalidate because project 5dc799010f734666a7da147fc64acebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:54.875684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:54.878658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:54.883138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1077/2179] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:54 2022] DELETE /identity/v3/projects/5dc799010f734666a7da147fc64acebc => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:54.887424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:54.889169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:54.909541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb1848-d7e6-49b2-969a-12a6db934026 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:55.051754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:55.058961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:55.060321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:55.060690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] PATH_INFO: `/v3/users/e69dc432821041dfbb3e5aa49004a6b4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:55.063405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69dc432821041dfbb3e5aa49004a6b4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:55.066535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:55.157835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69dc432821041dfbb3e5aa49004a6b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.158464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69dc432821041dfbb3e5aa49004a6b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.166453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69dc432821041dfbb3e5aa49004a6b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.178627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69dc432821041dfbb3e5aa49004a6b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.179305 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-eaa0877e-93de-45ff-a543-186ee3965d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69dc432821041dfbb3e5aa49004a6b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.208079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1103/2180] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:54 2022] DELETE /identity/v3/users/e69dc432821041dfbb3e5aa49004a6b4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:55.637852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:55.642598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:55.666192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fdd6f-c40a-4c87-9f58-5bcebfe8a986 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:55.789805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:55.792531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:55.794820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:55.807749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] PATH_INFO: `/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:55.809886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2182f6406aa49b3afee49c9ba71e3f5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:55.813108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:55.862738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:55.909074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2182f6406aa49b3afee49c9ba71e3f5', 'request_id': 'req-41838128-50af-46d1-9e13-0ed8eec0eb17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.934829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2182f6406aa49b3afee49c9ba71e3f5', 'request_id': 'req-41838128-50af-46d1-9e13-0ed8eec0eb17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.947337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2182f6406aa49b3afee49c9ba71e3f5', 'request_id': 'req-41838128-50af-46d1-9e13-0ed8eec0eb17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.976823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] The token cache is being invalidate because project c2182f6406aa49b3afee49c9ba71e3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:55.977954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.979899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-41838128-50af-46d1-9e13-0ed8eec0eb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:55.994732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1078/2181] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:55 2022] DELETE /identity/v3/projects/c2182f6406aa49b3afee49c9ba71e3f5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:56.000773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.001205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.001384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.040207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:56.041714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:56.108289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:56.166148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1104/2182] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:56.174874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.175118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.175551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.204407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:56.207405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:56.228371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1079/2183] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:56.229091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.243799 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c359-b0a2-4e13-906c-0e0d37aa2989 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.255634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.256421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.256794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.257302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.258268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:56.258678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.260947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.289632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1105/2184] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:29:56.293711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.307276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf5fd-1b17-4dcd-9307-831f9894a2f1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.321246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.322233 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.322954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.323375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.324241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.341111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.405430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1080/2185] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:56 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:56.413913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.433687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf20f-f069-4756-9ca1-07fd9cb4ed6d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.527980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.528762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.529213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.529518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.530288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.532695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.566621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1106/2186] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:56 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:29:56.573193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.607229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b69f8-4c5b-40f1-9637-d6fac5f06585 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.629868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.630560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.634962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.635326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.637017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.644382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.671760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1081/2187] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:56.674488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.687786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dfb88-ff97-4cf8-855c-081a859069c7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.697102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.697708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.697978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.698260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.699128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.701811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628efb6-6e68-4f03-8afa-cd54aba43fe7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.718591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1107/2188] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:56.721789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.735980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea6293-5fda-4efe-bef7-456e3d0b5272 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:56.746332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:56.747282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.747566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.748455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] PATH_INFO: `/v3/projects/5a7cf3c2c6ae4be0b869f4f52747ea1a/users/b671ebe92371456bac0cb89fadef7230/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.768436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7cf3c2c6ae4be0b869f4f52747ea1a, user_id=b671ebe92371456bac0cb89fadef7230, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:56.771525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:56.787606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1082/2189] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:56 2022] PUT /identity/v3/projects/5a7cf3c2c6ae4be0b869f4f52747ea1a/users/b671ebe92371456bac0cb89fadef7230/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:56.860150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:56.860808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:56.861146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:56.900914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] MFA Rules not processed for user `b671ebe92371456bac0cb89fadef7230`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:56.902163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:56.980767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1108/2190] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:56.991922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:56.993696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:57.052826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85008b-1677-47e6-9622-fd7f9a96639d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:57.056568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:57.057214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:57.057497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:57.057773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:57.066300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:57.067746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3214f-3585-42d9-b096-ac971c8884eb service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:57.078084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1083/2191] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:58.394574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:58.396249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:58.468665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:58.486707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410f46-bce8-4410-a50a-95955fdbc893 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:58.491219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:58.492110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:58.492397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:58.492672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] PATH_INFO: `/v3/users/1078ff1d81da4c86ba148e91fd3457ab` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:58.493867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1078ff1d81da4c86ba148e91fd3457ab)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:58.495826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:58.543948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1078ff1d81da4c86ba148e91fd3457ab'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:58.544635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1078ff1d81da4c86ba148e91fd3457ab'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:58.551315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1078ff1d81da4c86ba148e91fd3457ab'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:58.559267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1078ff1d81da4c86ba148e91fd3457ab'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:58.559882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1078ff1d81da4c86ba148e91fd3457ab'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:58.577955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1109/2192] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:29:58 2022] DELETE /identity/v3/users/1078ff1d81da4c86ba148e91fd3457ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:58.582662 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:58.583124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:58.583238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:58.601051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:58.602968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:58.651838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:58.671173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1084/2193] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:58.682237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:58.683681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:58.748870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8d36e-dc6b-4c20-a2db-4841aef53f5d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:58.753652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:58.754612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:58.754911 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:58.755227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:58.768298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:58.769801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54a43-3f72-4ada-bcc0-101ea01370c9 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:58.782944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1110/2194] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:29:59.071156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.072584 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:59.094091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962bea3-2516-43dd-a367-cc1a315b7d8f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.099028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.099790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.100279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.100558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] PATH_INFO: `/v3/projects/b80bb50bbc24493b9463e4257e37ac79` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.101962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80bb50bbc24493b9463e4257e37ac79)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.104220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.152643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80bb50bbc24493b9463e4257e37ac79', 'request_id': 'req-1fce2b8a-86ed-45cf-9f25-88d7813af308'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:59.160443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80bb50bbc24493b9463e4257e37ac79', 'request_id': 'req-1fce2b8a-86ed-45cf-9f25-88d7813af308'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:59.166145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80bb50bbc24493b9463e4257e37ac79', 'request_id': 'req-1fce2b8a-86ed-45cf-9f25-88d7813af308'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:59.179338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] The token cache is being invalidate because project b80bb50bbc24493b9463e4257e37ac79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:29:59.179549 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:59.180433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1fce2b8a-86ed-45cf-9f25-88d7813af308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:29:59.181960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1085/2195] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:29:59 2022] DELETE /identity/v3/projects/b80bb50bbc24493b9463e4257e37ac79 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:59.186884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.187171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.187448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.205277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:59.206473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:59.265642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1111/2196] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:29:59.273887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391302-074b-4047-a10c-10695636f515 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.274171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391302-074b-4047-a10c-10695636f515 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.274444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391302-074b-4047-a10c-10695636f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.293417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-37391302-074b-4047-a10c-10695636f515 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:59.294668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-37391302-074b-4047-a10c-10695636f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:59.302566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1086/2197] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:59.306955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.317218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2a49-581e-490c-846d-2c23f49b786e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.322059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.322729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.323021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.323297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.324072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:29:59.324379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.326518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.329162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:29:59.344482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1112/2198] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:29:59.346373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391302-074b-4047-a10c-10695636f515 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.356002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391302-074b-4047-a10c-10695636f515 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.365474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.366118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.366397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.366672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.367373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.369311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.396142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1087/2199] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:29:59 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:59.400246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.415783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53721e-c05d-4c5a-ae35-b866665700d2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.479286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.479867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.480191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.480469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.481321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.483320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.505835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1113/2200] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:29:59 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:29:59.507015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.526277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7bda3-e906-48c7-9e7c-ef2c69cd5aac admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.531612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.532704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.532987 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.533260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.534038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.535621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.549704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1088/2201] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:29:59.553614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.564429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815f1d-b879-4261-8b62-f635c631b62f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.569298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.569946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.570228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.570501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.571324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.573010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758423d8-7364-4367-81eb-212f47465975 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.584101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1114/2202] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:29:59.588231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.605047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987d91-46f5-4418-bd14-cb28a795350d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.613349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.614380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.614704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.614983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] PATH_INFO: `/v3/projects/676af62e3e1746b190bf9d58b9690ee8/users/02803c7d2f344226be39200df65d3ddf/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.632290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676af62e3e1746b190bf9d58b9690ee8, user_id=02803c7d2f344226be39200df65d3ddf, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.635143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.649126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1089/2203] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:29:59 2022] PUT /identity/v3/projects/676af62e3e1746b190bf9d58b9690ee8/users/02803c7d2f344226be39200df65d3ddf/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:29:59.659970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.660294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.660604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.697183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] MFA Rules not processed for user `02803c7d2f344226be39200df65d3ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:29:59.698556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:59.775058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1115/2204] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:29:59.787543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:29:59.789539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:29:59.853022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cefb9-40ac-400d-94bf-2365193aa815 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:29:59.856907 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:29:59.858054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:29:59.858334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:29:59.858615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:29:59.867614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:29:59.869801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d07e9-fe2f-482e-b8fa-13bd1a03bf1f service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:29:59.884942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1090/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:02.395853 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:02.397640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:02.493028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55bd3e-4687-4276-bcae-907072be852c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:02.499359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:02.500335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:02.500688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:02.501031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] PATH_INFO: `/v3/users/26a11e98051b4bec84b6a75eafceb7a1` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:02.502362 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a11e98051b4bec84b6a75eafceb7a1)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:02.504829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:02.516729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:02.588282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a11e98051b4bec84b6a75eafceb7a1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:02.588991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a11e98051b4bec84b6a75eafceb7a1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:02.598697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a11e98051b4bec84b6a75eafceb7a1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:02.619949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a11e98051b4bec84b6a75eafceb7a1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:02.621159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a11e98051b4bec84b6a75eafceb7a1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:02.673545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1116/2206] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:02 2022] DELETE /identity/v3/users/26a11e98051b4bec84b6a75eafceb7a1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:02.680226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:02.680773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:02.681162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:02.707879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:02.709252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:02.715873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:02.782344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1091/2207] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:02.794129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:02.796926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:02.863801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450b7b-6b0b-4958-bc21-f1844c23cc45 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:02.867623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:02.868312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:02.868593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:02.868868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:02.878822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:02.880314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fd68-8fde-40d4-ba74-257e332112de service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:02.890492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1117/2208] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:30:03.240323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:03.242252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:03.284761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abc6a3-1c24-4565-a3a2-bb0af88c0493 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:03.292558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:03.293689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.294418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.294763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] PATH_INFO: `/v3/projects/0e133b9c10054c8d84f06ebcd769685c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.296894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e133b9c10054c8d84f06ebcd769685c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:03.298891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:03.378943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e133b9c10054c8d84f06ebcd769685c', 'request_id': 'req-5149940f-59bd-4a39-8653-c51fedd4a1fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:03.390325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e133b9c10054c8d84f06ebcd769685c', 'request_id': 'req-5149940f-59bd-4a39-8653-c51fedd4a1fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:03.400125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e133b9c10054c8d84f06ebcd769685c', 'request_id': 'req-5149940f-59bd-4a39-8653-c51fedd4a1fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:03.421935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] The token cache is being invalidate because project 0e133b9c10054c8d84f06ebcd769685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:03.422251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:03.423438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5149940f-59bd-4a39-8653-c51fedd4a1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:03.426894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1092/2209] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:03 2022] DELETE /identity/v3/projects/0e133b9c10054c8d84f06ebcd769685c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:03.436347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.436347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.436347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.461796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:03.463045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:03.587027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1118/2210] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:30:03.600254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.600254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.600254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.625975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:03.628382 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:03.643773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1093/2211] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:03.647966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:03.688109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3d0bd-c50d-4e6e-8625-7d242778e17d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:03.710593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:03.711997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.711997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.712314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.713474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:30:03.713822 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:03.716927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:03.741177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1119/2212] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:30:03.742769 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:03.776737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a256e-1ab7-4ed8-894d-fbf2e763d97f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:03.782938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:03.783712 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.784005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.784312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.794102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:03.794102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:03.837126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1094/2213] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:30:03 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:30:03.840934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:03.852109 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5f74-b0ac-4dcd-8ad9-0790e179b696 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:03.864796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:03.966713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:03.967931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:03.968239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:03.968515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:03.969220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:03.971158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:03.996861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1120/2214] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:30:03 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:30:04.001110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:04.012582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b9d7f-505e-4af2-9ee0-cf0393eb18c6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:04.017288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:04.019017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:04.019304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:04.019590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:04.020360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:04.021982 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:04.039259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1095/2215] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:04.043115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:04.056508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cfb5-763d-4b9e-a6ae-64a38bde7544 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:04.061277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:04.061931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:04.062218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:04.062494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:04.063233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:04.064905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f472316-41d8-45d3-bd67-517ee6f67c12 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:04.079298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1121/2216] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:04.081333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:04.091799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f8ad-d118-4cb9-a70a-87ee38902b63 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:04.097434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:04.098487 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:04.098870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:04.099323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] PATH_INFO: `/v3/projects/35b4e76d875243c8bdeba45e9565906e/users/8dbab2350791421eac336171a75d4ab8/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:04.115802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b4e76d875243c8bdeba45e9565906e, user_id=8dbab2350791421eac336171a75d4ab8, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:04.118997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:04.138020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1096/2217] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:30:04 2022] PUT /identity/v3/projects/35b4e76d875243c8bdeba45e9565906e/users/8dbab2350791421eac336171a75d4ab8/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:30:04.149790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:04.150512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:04.150953 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:04.182649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] MFA Rules not processed for user `8dbab2350791421eac336171a75d4ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:04.183921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:04.263181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1122/2218] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:04.276816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:04.278585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:04.315097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:04.341658 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3a776-68f4-4c67-abca-36e1950728d2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:04.346706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:04.347341 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:04.347620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:04.347889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:04.356572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:04.357985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecd775-bead-4b01-9f23-1409be20ae5e service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:04.366777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1097/2219] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:10.690467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:10.691875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:10.761950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7791a-3773-4976-803d-cd1b4c4a5d7c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:10.767222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:10.768129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:10.768413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:10.768687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] PATH_INFO: `/v3/users/b671ebe92371456bac0cb89fadef7230` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:10.770771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b671ebe92371456bac0cb89fadef7230)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:10.772765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:10.803803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:10.831730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b671ebe92371456bac0cb89fadef7230'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:10.832552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b671ebe92371456bac0cb89fadef7230'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:10.841553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b671ebe92371456bac0cb89fadef7230'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:10.859706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b671ebe92371456bac0cb89fadef7230'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:10.859706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b671ebe92371456bac0cb89fadef7230'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:10.880628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1123/2220] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:10 2022] DELETE /identity/v3/users/b671ebe92371456bac0cb89fadef7230 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:10.885137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:10.886125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:10.886125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:10.907627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:10.912151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:10.971927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1098/2221] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:30:10.990060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:10.992991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:11.053969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6788-c97a-48fb-ac78-5ee4221a674e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:11.057854 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:11.058580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:11.058935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:11.059254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:11.069861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:11.080228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:11.084196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1124/2222] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:11.387566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:11.389748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:11.402925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd7b6-6568-49df-a0cc-b4fbb0920784 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:11.414120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:11.414999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:11.415265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:11.415534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] PATH_INFO: `/v3/projects/5a7cf3c2c6ae4be0b869f4f52747ea1a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:11.416889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7cf3c2c6ae4be0b869f4f52747ea1a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:11.418710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:11.478961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7cf3c2c6ae4be0b869f4f52747ea1a', 'request_id': 'req-98faad5e-420f-4192-b03b-f4ed573df0fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:11.488057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7cf3c2c6ae4be0b869f4f52747ea1a', 'request_id': 'req-98faad5e-420f-4192-b03b-f4ed573df0fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:11.494854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7cf3c2c6ae4be0b869f4f52747ea1a', 'request_id': 'req-98faad5e-420f-4192-b03b-f4ed573df0fa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:11.509376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] The token cache is being invalidate because project 5a7cf3c2c6ae4be0b869f4f52747ea1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:11.509676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:11.510393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-98faad5e-420f-4192-b03b-f4ed573df0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:11.512112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1099/2223] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:11 2022] DELETE /identity/v3/projects/5a7cf3c2c6ae4be0b869f4f52747ea1a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:30:15.627654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:15.629114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:15.643131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ef21a-cf60-4e14-b41a-4e12dd7e4ab5 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:15.698718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:15.699610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:15.700375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:15.700375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] PATH_INFO: `/v3/users/8dbab2350791421eac336171a75d4ab8` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:15.701437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbab2350791421eac336171a75d4ab8)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:15.703975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:15.752115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:15.753649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbab2350791421eac336171a75d4ab8'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:15.754298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbab2350791421eac336171a75d4ab8'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:15.763467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbab2350791421eac336171a75d4ab8'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:15.776794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbab2350791421eac336171a75d4ab8'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:15.777512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbab2350791421eac336171a75d4ab8'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:15.796509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1125/2224] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:15 2022] DELETE /identity/v3/users/8dbab2350791421eac336171a75d4ab8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:15.801428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:15.801948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:15.802066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:15.819248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:15.820636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:15.873253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:15.887156 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1100/2225] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:15.894355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:15.895775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:15.954617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691b0-8e6d-471d-9df0-7a0e3259ec41 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:15.958255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:15.958895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:15.959175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:15.959451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:15.968324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:15.969771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:15.980494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1126/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:16.345782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:16.347514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:16.362371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940e005-0394-4de0-9a6f-8ef1ceea63eb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:16.367004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:16.367868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:16.368191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:16.368470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] PATH_INFO: `/v3/projects/35b4e76d875243c8bdeba45e9565906e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:16.369772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b4e76d875243c8bdeba45e9565906e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:16.371740 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:16.419475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b4e76d875243c8bdeba45e9565906e', 'request_id': 'req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:16.427222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b4e76d875243c8bdeba45e9565906e', 'request_id': 'req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:16.434844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b4e76d875243c8bdeba45e9565906e', 'request_id': 'req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:16.446764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] The token cache is being invalidate because project 35b4e76d875243c8bdeba45e9565906e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:16.447046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:16.447689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-349c3371-b2b8-4f3d-bcfe-88de6db13b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:16.449247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1101/2227] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:16 2022] DELETE /identity/v3/projects/35b4e76d875243c8bdeba45e9565906e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:19.196584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:19.198039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:19.210856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7b164-4324-4441-8b38-13d49d32a645 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:19.269457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:19.270415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:19.270696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:19.270967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] PATH_INFO: `/v3/users/8e19b0dccb444c8795d191d046648206` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:19.272351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e19b0dccb444c8795d191d046648206)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:19.275205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:19.338826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e19b0dccb444c8795d191d046648206'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.339618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e19b0dccb444c8795d191d046648206'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.350964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e19b0dccb444c8795d191d046648206'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.359936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e19b0dccb444c8795d191d046648206'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.363618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e19b0dccb444c8795d191d046648206'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.369282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:19.386363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1127/2228] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:19 2022] DELETE /identity/v3/users/8e19b0dccb444c8795d191d046648206 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:19.391407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:19.391874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:19.391976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:19.410440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:19.411634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:19.475226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1102/2229] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:19.486288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:19.487881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:19.546148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20514-9ba3-4793-8f4b-fb2e7160ddf4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:19.549802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:19.550441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:19.550726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:19.551006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:19.560044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:19.561484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:19.570918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1128/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:19.899812 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:19.901283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:19.920512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbd98-472d-4810-a3ac-5b10f6521902 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:19.926643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:19.927576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:19.927843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:19.928303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] PATH_INFO: `/v3/projects/f06258b1f38944b481588cd591d1a3c5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:19.929992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06258b1f38944b481588cd591d1a3c5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:19.932628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:19.982137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06258b1f38944b481588cd591d1a3c5', 'request_id': 'req-e4b4557c-0999-4e11-8497-15c61f98ab17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.990266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06258b1f38944b481588cd591d1a3c5', 'request_id': 'req-e4b4557c-0999-4e11-8497-15c61f98ab17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:19.996262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06258b1f38944b481588cd591d1a3c5', 'request_id': 'req-e4b4557c-0999-4e11-8497-15c61f98ab17'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:20.007486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] The token cache is being invalidate because project f06258b1f38944b481588cd591d1a3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:20.007777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:20.008455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e4b4557c-0999-4e11-8497-15c61f98ab17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:20.010007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1103/2231] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:19 2022] DELETE /identity/v3/projects/f06258b1f38944b481588cd591d1a3c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:29.566693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=2,keystone:SELECT=31 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:30.004292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:35.056129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:35.057900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.071043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535dfc-b6e6-4e67-bb5a-d59a4a5226f3 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:35.136623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:35.137758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.138141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.138420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] PATH_INFO: `/v3/users/02803c7d2f344226be39200df65d3ddf` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.139715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02803c7d2f344226be39200df65d3ddf)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:35.141758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:35.192402 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02803c7d2f344226be39200df65d3ddf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.193083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02803c7d2f344226be39200df65d3ddf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.200282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02803c7d2f344226be39200df65d3ddf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.209088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02803c7d2f344226be39200df65d3ddf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.209719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02803c7d2f344226be39200df65d3ddf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.230152 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1129/2232] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:35 2022] DELETE /identity/v3/users/02803c7d2f344226be39200df65d3ddf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:35.234751 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.235227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.235495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.255565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:35.256800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.318521 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1104/2233] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:35.328127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:35.329531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.391696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332df8-3b55-48ae-9b77-c62981e4b386 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:35.395503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:35.396198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.396474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.396744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.406103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:35.407541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577fe0d-d4b0-41b4-9246-48e34b729e68 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:35.417889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1130/2234] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:35.704077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:35.705942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.719669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb47fa-a8ea-453b-9a43-7581d9663c2a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:35.729898 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:35.730762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.731036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.731307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] PATH_INFO: `/v3/projects/676af62e3e1746b190bf9d58b9690ee8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.732567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676af62e3e1746b190bf9d58b9690ee8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:35.734892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:35.790113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676af62e3e1746b190bf9d58b9690ee8', 'request_id': 'req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.798292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676af62e3e1746b190bf9d58b9690ee8', 'request_id': 'req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.804377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676af62e3e1746b190bf9d58b9690ee8', 'request_id': 'req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.815577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] The token cache is being invalidate because project 676af62e3e1746b190bf9d58b9690ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:35.815946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.816733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dd33f5e8-7b46-46f6-8363-c2c0a0e21318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:35.819352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1105/2235] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:35 2022] DELETE /identity/v3/projects/676af62e3e1746b190bf9d58b9690ee8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:35.823224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.823512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.823789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.843559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:35.845011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.863706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:35.913112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1131/2236] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:35.920731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.921015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.921324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.940599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:35.941814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:35.949911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1106/2237] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:35.954291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:35.965155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78290129-4e69-402c-8761-5373ed8c9dec None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:35.971019 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:35.971681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:35.971964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:35.972271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:35.973007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:30:35.973344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:35.975027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:35.992200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1132/2238] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:30:35.992460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.006222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af347129-2287-4bca-abfc-1ee1710d643b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.011344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.012138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.012498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.012843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.013629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.015634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.045570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1107/2239] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:30:35 2022] POST /identity/v3/projects => generated 395 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:30:36.049461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.060396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34191992-60c0-412d-a155-ccfdbb039bc8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.123857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.124561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.124847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.125123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.125830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.128347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.150359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1133/2240] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:30:36 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:30:36.154630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.165403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33237b-bfc5-42d3-85f9-3c8abce23360 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.170071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.170721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.170998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.171270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.171999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.173673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.187055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1108/2241] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:36.188286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.200734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc42f0-29d9-4a1f-af2c-6c7f3e7e44fc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.206165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.206817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.207093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.207365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.208127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.209721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6e0f8-45e9-4f12-b24c-b38edeb24170 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.224077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1134/2242] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:36.225640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.236749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa7a9-b96b-4932-b509-695f76ea1884 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.241871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.242754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.243039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.243447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] PATH_INFO: `/v3/projects/6eca39fffd4e45f3aae1c1c61c768d46/users/d52f38b4a3714e219ca95885aece4f99/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.260514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eca39fffd4e45f3aae1c1c61c768d46, user_id=d52f38b4a3714e219ca95885aece4f99, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.263203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.281227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1109/2243] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:30:36 2022] PUT /identity/v3/projects/6eca39fffd4e45f3aae1c1c61c768d46/users/d52f38b4a3714e219ca95885aece4f99/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:36.291715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.292001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.292303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.319809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] MFA Rules not processed for user `d52f38b4a3714e219ca95885aece4f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:36.321172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:36.387542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1135/2244] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:36.410936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:36.415321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:36.437721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:36.476659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7644a9-0a7d-4360-9393-f5ff15967776 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:36.480629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:36.481275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:36.481559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:36.481835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:36.491371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:36.492857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5ee98-09ee-41af-a392-0047c36ed88d service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:36.502500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1110/2245] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:41.506191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:41.525580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:41.572126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ee74c-2ca5-42ed-ae29-16922db5dfb6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:41.577112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:41.577985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:41.578265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:41.578538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] PATH_INFO: `/v3/users/d52f38b4a3714e219ca95885aece4f99` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:41.579728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52f38b4a3714e219ca95885aece4f99)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:41.581684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:41.638705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52f38b4a3714e219ca95885aece4f99'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:41.639543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52f38b4a3714e219ca95885aece4f99'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:41.647176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52f38b4a3714e219ca95885aece4f99'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:41.655428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52f38b4a3714e219ca95885aece4f99'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:41.656119 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52f38b4a3714e219ca95885aece4f99'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:41.673160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1136/2246] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:30:41 2022] DELETE /identity/v3/users/d52f38b4a3714e219ca95885aece4f99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:30:41.678289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:41.679229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:41.679788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:41.729388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:41.730582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:41.832913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1111/2247] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:30:41.842866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:41.844648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:41.931462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0d9e2-3f7a-4239-962c-f2bf3ba498d0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:41.935554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:41.936601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:41.937047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:41.937489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:41.948419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:41.950034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd8bb1-0d11-4af2-82eb-6bd4dbfbe870 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:41.960722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1137/2248] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:42.249835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.252537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:42.276103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2b2ba-76af-494e-bf88-1d412cd3b0e9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.281333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.282188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.282531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.282754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] PATH_INFO: `/v3/projects/6eca39fffd4e45f3aae1c1c61c768d46` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.284091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eca39fffd4e45f3aae1c1c61c768d46)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.286603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.337895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eca39fffd4e45f3aae1c1c61c768d46', 'request_id': 'req-f48da56c-7a39-4e7c-872d-f04f1be42494'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:42.339707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:42.347738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eca39fffd4e45f3aae1c1c61c768d46', 'request_id': 'req-f48da56c-7a39-4e7c-872d-f04f1be42494'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:42.354537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eca39fffd4e45f3aae1c1c61c768d46', 'request_id': 'req-f48da56c-7a39-4e7c-872d-f04f1be42494'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:42.366505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] The token cache is being invalidate because project 6eca39fffd4e45f3aae1c1c61c768d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:30:42.366795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:42.367419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f48da56c-7a39-4e7c-872d-f04f1be42494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:30:42.369074 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1112/2249] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:30:42 2022] DELETE /identity/v3/projects/6eca39fffd4e45f3aae1c1c61c768d46 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:42.373923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.374213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.374492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.414444 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:42.415637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:42.428334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:42.476939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1138/2250] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:42.486440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.486756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.487034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.505253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:42.506444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:42.514216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1113/2251] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:42.518186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.528841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a0506-6845-4603-aff8-d1d6de6204cb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.533814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.534567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.534972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.535258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.536678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:30:42.536992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.538845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.552643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1139/2252] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:30:42.557068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.570176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351bef-575d-42fc-8702-9d96f1f56177 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.575779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.576657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.577013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.577377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.578084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.580003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.607425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1114/2253] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:30:42 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:30:42.611515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.622191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326449-333d-4692-8bcb-c56749ebb511 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.679781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.680479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.680770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.681045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.681744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.683683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.706206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1140/2254] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:30:42 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:30:42.708166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.718477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa1708-c781-4788-9601-7177cba0a007 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.723076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.724305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.724588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.724864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.725586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.727183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.738135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1115/2255] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:42.742194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.753847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22551545-de3c-47a0-b3cd-3add5d3aa0a9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.761076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.761739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.762031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.762309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.763182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.764859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560b517-5929-4a2e-9c62-45e707a7978b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.779227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1141/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:30:42.780582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.793544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642cb2b-db9e-4d9a-9de6-30d4f89012ae admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:42.798636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:42.799504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.799784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.800209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] PATH_INFO: `/v3/projects/8e49baadf26b4287854b3c6de905bf72/users/4161564548194bf395ad7efa112af26e/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.815091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e49baadf26b4287854b3c6de905bf72, user_id=4161564548194bf395ad7efa112af26e, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:42.818342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:42.831478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1116/2257] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:30:42 2022] PUT /identity/v3/projects/8e49baadf26b4287854b3c6de905bf72/users/4161564548194bf395ad7efa112af26e/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:42.836806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4c3d-efb6-4d03-9272-620b45124903 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:42.837096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4c3d-efb6-4d03-9272-620b45124903 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:42.837501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4c3d-efb6-4d03-9272-620b45124903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:42.855543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-61bd4c3d-efb6-4d03-9272-620b45124903 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:42.856773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-61bd4c3d-efb6-4d03-9272-620b45124903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:42.919100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1142/2258] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:42.929165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:42.930911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:43.023926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3fb5-c8b1-4e7a-86aa-cd928ec88d97 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:43.027470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:43.028133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:43.028411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:43.028695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:43.037978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:43.039396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:43.048970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1117/2259] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:30:47.401176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.401685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.401796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.432704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] MFA Rules not processed for user `4161564548194bf395ad7efa112af26e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:47.433923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:47.447713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:47.503351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1143/2260] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:47.508634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.518432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af342a-5fe7-4ac2-aa86-c512b284551f service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.523209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.523856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.524176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.524451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.525148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.527072 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.555417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1118/2261] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:30:47 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:30:47.559051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.570941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5a894-a2de-472e-b845-03dda6f50726 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.631962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.632585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.632871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.633146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.633871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.635891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.656097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1144/2262] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:30:47 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:30:47.659973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.680065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a71f8-820c-4466-8ae4-58ef2becca8d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.680713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.681325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.681608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.681887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.682620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.686255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.700446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.700871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1119/2263] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:47.713325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba19e8-27c0-4fe8-85a8-a24bf6024fcc admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.718059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.718924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.719205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.719475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] PATH_INFO: `/v3/projects/c46fac233a884b42b796034660159c04/users/936a34134f4a4e10942561f3f4802f94/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.739858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46fac233a884b42b796034660159c04, user_id=936a34134f4a4e10942561f3f4802f94, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.743096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.758479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1145/2264] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:30:47 2022] PUT /identity/v3/projects/c46fac233a884b42b796034660159c04/users/936a34134f4a4e10942561f3f4802f94/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:47.762397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.772888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac2b3-101c-48d5-8527-bb5dad979273 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.777852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:47.839136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.839810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.840119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.840399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.841121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.842737 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094bb02-08c9-4387-b45f-836539ffa815 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.856051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1120/2265] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:30:47.858051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:47.869445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1eb33-6a72-4d10-82a2-8468c3586b25 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:47.874024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:47.874905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:47.875185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:47.875457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] PATH_INFO: `/v3/projects/c46fac233a884b42b796034660159c04/users/936a34134f4a4e10942561f3f4802f94/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:47.877584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46fac233a884b42b796034660159c04, user_id=936a34134f4a4e10942561f3f4802f94, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:47.880368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:47.891663 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1146/2266] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:30:47 2022] PUT /identity/v3/projects/c46fac233a884b42b796034660159c04/users/936a34134f4a4e10942561f3f4802f94/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:30:53.032788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568053e-f5e7-4b21-8669-f6d52f795215 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:53.033300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568053e-f5e7-4b21-8669-f6d52f795215 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:53.033403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568053e-f5e7-4b21-8669-f6d52f795215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:53.064912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4568053e-f5e7-4b21-8669-f6d52f795215 None None] MFA Rules not processed for user `936a34134f4a4e10942561f3f4802f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:53.066141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4568053e-f5e7-4b21-8669-f6d52f795215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:53.145700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1121/2267] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:30:53.159656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:30:53.166099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:53.277568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c9-23cb-491c-841e-cf55d49a0554 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:30:53.284749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:30:53.285433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:53.285881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:53.286164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:53.291617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:30:53.359875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:30:53.364766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9619e06-ac77-4b11-86ce-2c3840dac330 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:30:53.382869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1147/2268] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:30:54.667568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044525c-b42c-4f4c-95b7-b6e18f7e68d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:30:54.668101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044525c-b42c-4f4c-95b7-b6e18f7e68d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:30:54.668215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044525c-b42c-4f4c-95b7-b6e18f7e68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:30:54.687917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0044525c-b42c-4f4c-95b7-b6e18f7e68d1 None None] MFA Rules not processed for user `4161564548194bf395ad7efa112af26e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:30:54.689259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0044525c-b42c-4f4c-95b7-b6e18f7e68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:30:54.696967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1122/2269] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:30:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:31:03.372945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=25 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:31:04.682313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=62 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:31:10.661174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:31:10.661699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:31:10.661795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:31:10.678468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] MFA Rules not processed for user `0ee2ea9e5d3d43138971f800369fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:31:10.680250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:31:10.735882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1148/2270] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:31:16.775635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997ca2-a8b0-4712-8a8d-661c0fe0b805 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:31:16.776173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997ca2-a8b0-4712-8a8d-661c0fe0b805 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:31:16.776278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997ca2-a8b0-4712-8a8d-661c0fe0b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:31:16.795226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-16997ca2-a8b0-4712-8a8d-661c0fe0b805 None None] MFA Rules not processed for user `d39a17af7fa84627b4d3e6543000ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:31:16.796599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16997ca2-a8b0-4712-8a8d-661c0fe0b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:31:16.850456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1123/2271] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:31:20.728903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=25 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:31:26.843697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=25 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:31:37.696760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:31:37.767346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e683-9932-44ec-b9d6-569d3967bcb7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:31:37.770959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:31:37.772173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:31:37.772458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:31:37.772752 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:31:37.783141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:31:37.784471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:31:37.795917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1149/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:31:47.790781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=26 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:31:59.848879 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:31:59.849381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:31:59.849488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:31:59.907251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:31:59.908483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:31:59.980230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1124/2273] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:32:00.023667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:00.025166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:00.114726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc35ce-23dd-4622-8545-d7a33c904628 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:00.120363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:00.121009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:00.121291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:00.121568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:00.130045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:00.132275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370a0e5-8a1f-420f-904b-3033b3cf1c21 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:00.140313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1150/2274] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:32:09.977129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=47 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:32:10.137025 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=41 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:32:15.973633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:15.975040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:16.065339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1115a2-8db5-4a52-945e-4d63b5ec8659 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:16.070902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:16.071542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:16.071826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:16.072131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:16.073972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:16.085034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:16.086629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74370311-a3ee-46b1-9842-c89e2697d7c4 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:16.096179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1125/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:32:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:32:17.457376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.457977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.457977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.459278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1151/2276] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:32:17.466057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a37a-4019-4731-b7ad-c552157463ed None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.466533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a37a-4019-4731-b7ad-c552157463ed None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.466651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a37a-4019-4731-b7ad-c552157463ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.527780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1321a37a-4019-4731-b7ad-c552157463ed None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:32:17.529020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1321a37a-4019-4731-b7ad-c552157463ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:17.551281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1126/2277] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:32:17.562855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:17.564601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:17.650483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f820-757b-4596-ba8f-223981112528 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:17.654076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:17.654714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.654998 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.655276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.665247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:17.666682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904992e-4eb9-4451-b9be-f501547432a1 service glance] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:17.677262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1152/2278] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:32:17.743220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b962b-ea72-4c95-80ec-a3f2d1460ed3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.743504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b962b-ea72-4c95-80ec-a3f2d1460ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.743783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b962b-ea72-4c95-80ec-a3f2d1460ed3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.745187 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1127/2279] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:32:17.749902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722fcd-3f11-473a-9462-ae36c4c09e50 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.750293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722fcd-3f11-473a-9462-ae36c4c09e50 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.750656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722fcd-3f11-473a-9462-ae36c4c09e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.770986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2b722fcd-3f11-473a-9462-ae36c4c09e50 None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:32:17.772561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2b722fcd-3f11-473a-9462-ae36c4c09e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:17.779611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1153/2280] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:32:17.791191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b962b-ea72-4c95-80ec-a3f2d1460ed3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:17.803369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b962b-ea72-4c95-80ec-a3f2d1460ed3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:17.806891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:17.807511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.807798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.808108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.815115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:17.816578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c108f-5d1c-4cd9-a1d1-2935cf596f06 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:17.824922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1128/2281] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:32:17.906348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a29f-21e5-4ccc-b6be-4fed9b931402 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.906638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a29f-21e5-4ccc-b6be-4fed9b931402 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.906913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a29f-21e5-4ccc-b6be-4fed9b931402 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.908359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1154/2282] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:32:17.913539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a663b-ec52-466f-ba97-324fd0660d5b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.913829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a663b-ec52-466f-ba97-324fd0660d5b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.914104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a663b-ec52-466f-ba97-324fd0660d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.939148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-114a663b-ec52-466f-ba97-324fd0660d5b None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:32:17.940392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-114a663b-ec52-466f-ba97-324fd0660d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:17.950297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1129/2283] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:32:17.960626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1a29f-21e5-4ccc-b6be-4fed9b931402 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:17.972203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1a29f-21e5-4ccc-b6be-4fed9b931402 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:17.975862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:17.976559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:17.976834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:17.977107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:17.987907 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:17.989357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:18.000442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1155/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:32:21.086711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720f00-3221-430c-8fb7-502b849c29c4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:21.087244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720f00-3221-430c-8fb7-502b849c29c4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:21.087244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720f00-3221-430c-8fb7-502b849c29c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:21.106093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3a720f00-3221-430c-8fb7-502b849c29c4 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:32:21.107312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3a720f00-3221-430c-8fb7-502b849c29c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:21.114814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1130/2285] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:32:21.127728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:21.140198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be666a-8eb4-4222-bf6f-8edd4cd51c99 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:21.145734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:21.146475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:21.146829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:21.147177 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:21.156617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:21.158406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:21.169685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1156/2286] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:32:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:32:31.100133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=75 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:32:31.165948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=50 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:32:46.385972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:46.386502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:46.386502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:46.403948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:32:46.405153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:32:46.412119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1131/2287] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:32:46.424827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:32:46.435955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357399-60fe-4043-95cd-bc04eda5c9f6 service swift] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:32:46.440946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:32:46.441563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:32:46.441840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:32:46.442126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:32:46.450599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:32:46.452283 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:32:46.460130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1157/2288] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:32:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 14:32:56.398908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:32:56.456925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:33:26.857796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:26.867541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c59a7-dc99-4285-ab05-937e99ae9be3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:26.871164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:26.871793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:26.872117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:26.872390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:26.874133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:26.887641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:26.889079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:26.900443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1132/2289] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:28.070380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:28.071780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:28.083506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4bfb6-6d90-468f-ad14-38f5ef9490cc service swift] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:28.087420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:28.088074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:28.088358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:28.088629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:28.090377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:28.103504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:28.104955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2a4cc-982a-42c5-a41c-d84c57f0da61 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:28.116191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1158/2290] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:36.895673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:33:38.111501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:33:40.745700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:40.747224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:40.761462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116ddb9-aaec-4da2-87d7-16561d13669d service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:40.766818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:40.767470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:40.767746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:40.768044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:40.769892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:40.780213 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:40.781806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:40.790762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1133/2291] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:50.786692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:33:54.373747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a28e8-8d43-425f-9e2e-faea3414b879 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:54.374307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a28e8-8d43-425f-9e2e-faea3414b879 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:54.374307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a28e8-8d43-425f-9e2e-faea3414b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:54.394083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0d1a28e8-8d43-425f-9e2e-faea3414b879 None None] MFA Rules not processed for user `0ee2ea9e5d3d43138971f800369fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:33:54.395315 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0d1a28e8-8d43-425f-9e2e-faea3414b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:54.402806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1159/2292] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:33:54.740259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:54.751352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475ed30-a616-4e3d-849d-c5f0e38f894a service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:54.755899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:54.757214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:54.757472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:54.757756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:54.759613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:54.769831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:54.771289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:54.780161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1134/2293] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:55.058375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:55.060391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:55.060776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:55.079148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] MFA Rules not processed for user `d39a17af7fa84627b4d3e6543000ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:33:55.080423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:55.087585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1160/2294] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:33:55.402913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:55.411826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bcd07-b8c0-4de1-a704-7aa90a62925a service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:55.418985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:55.419618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:55.419894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:55.420191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:55.421984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:55.432711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:55.434122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:55.442423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1135/2295] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:55.483318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:55.496629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac0db-fd9f-4b5a-ba3e-4c8b4b8755e5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:55.501934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:55.502561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:55.502840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:55.503114 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:55.504880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:55.564801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:55.566342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:55.575685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1161/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:33:55.763670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:33:55.765124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:55.784063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff984ba-3176-4330-8417-a17a610d53bf service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:33:55.790000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:33:55.790785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:33:55.791242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:33:55.791511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:33:55.793265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:33:55.813540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:33:55.815541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17e02c-df21-444c-9264-963b346043e2 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:33:55.826646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1136/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:33:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:34:02.979120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:34:02.990630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b5c9a-85aa-452a-a43e-4a36199e1b8c service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:34:02.996287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:34:02.997021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:02.997311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:02.997590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:02.999885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:03.014106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:34:03.015711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:34:03.027733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1162/2298] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:34:05.822109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=18 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:34:08.645923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:08.646593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:08.646593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:08.668614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] MFA Rules not processed for user `32a564c2e69a44ec97fa6996b259bd68`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:34:08.669821 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:08.676886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1137/2299] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:34:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:34:13.021923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=40 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:34:18.663239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:34:21.536144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:34:21.551304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554cfbe-8b82-4e3c-90f5-02567615f8d2 service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:34:21.557223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:34:21.557995 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:21.558386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:21.558765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:21.560729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:21.573418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:34:21.575183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045cefa-31c2-41ca-a562-998c9e94fffd service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:34:21.586871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1163/2300] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:34:31.581696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:34:42.411796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:34:42.413267 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:42.490101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313883-a5bb-4ac9-8a1f-c77e8d09b557 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:34:42.493717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:34:42.494352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:42.494634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:42.494910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:42.496668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:42.557603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:34:42.559066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:34:42.570095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1138/2301] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:34:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:34:48.449984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:48.450489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:48.450610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:48.469151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] MFA Rules not processed for user `9f8192ea4a174253afcebaf6f9d206c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:34:48.470333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:48.478139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1164/2302] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:34:52.564607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=57 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:34:54.659590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:34:54.668661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedcb56-2e46-4e58-b9b6-faae03e32fd0 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:34:54.672255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:34:54.672885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:34:54.673166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:34:54.674114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:34:54.675870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:34:54.685231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:34:54.686639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:34:54.694542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1139/2303] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:34:58.462604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:04.690980 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:07.384171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:07.385705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:07.398580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3358-b75c-4556-9df0-be21f5515e7f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:07.403260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:07.404113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:07.404401 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:07.404680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:07.407844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:07.424334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:07.425804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:07.437606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1165/2304] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:17.432409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:26.185597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:26.194094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185bcdc-7fd3-4ad3-904b-d39523ce182d service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:26.197671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:26.198299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:26.198583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:26.198860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:26.200644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:26.263520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:26.264986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:26.274919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1140/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:29.034829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.047524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9518-01f5-431d-8e71-3227d9662e6a service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.054654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.055534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.055815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.056309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.059568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:29.074345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.076979 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.092596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1166/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:29.103143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.108862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:29.131398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147dbc8-cbed-496e-9020-8c9c8a38b693 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.137055 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.137948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.138232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.138512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] PATH_INFO: `/v3/users/0ee2ea9e5d3d43138971f800369fad83` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.139735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee2ea9e5d3d43138971f800369fad83)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.142484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.195869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee2ea9e5d3d43138971f800369fad83'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.202738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee2ea9e5d3d43138971f800369fad83'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.203443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee2ea9e5d3d43138971f800369fad83'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.204659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee2ea9e5d3d43138971f800369fad83'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.211814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2abadb1f-1b97-433c-97f0-d66bf6aa4d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee2ea9e5d3d43138971f800369fad83'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.232588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1141/2307] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:29 2022] DELETE /identity/v3/users/0ee2ea9e5d3d43138971f800369fad83 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:29.402725 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.414134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83d3e-ff90-46f0-97a0-e36da7b6531f service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.470909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.471793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.472111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.472393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] PATH_INFO: `/v3/projects/26d62c47ada844ab9d6c98e1477e4582` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.473831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d62c47ada844ab9d6c98e1477e4582)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.475750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.520807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d62c47ada844ab9d6c98e1477e4582', 'request_id': 'req-fc0cf98a-de05-4d51-9109-5dddd8026c86'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.526158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d62c47ada844ab9d6c98e1477e4582', 'request_id': 'req-fc0cf98a-de05-4d51-9109-5dddd8026c86'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.533198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d62c47ada844ab9d6c98e1477e4582', 'request_id': 'req-fc0cf98a-de05-4d51-9109-5dddd8026c86'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.543775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] The token cache is being invalidate because project 26d62c47ada844ab9d6c98e1477e4582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:29.544080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.544696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fc0cf98a-de05-4d51-9109-5dddd8026c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:29.546223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1167/2308] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:29 2022] DELETE /identity/v3/projects/26d62c47ada844ab9d6c98e1477e4582 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:29.551771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.552294 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.552640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.570264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:29.571482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:29.629740 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1142/2309] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:29.637393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.637685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.637967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.656572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:29.657691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:29.665551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1168/2310] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:29.669669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.679231 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08874-f368-4278-9134-0a9bc4c24c99 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.683713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.684451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.684729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.685000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.685715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:35:29.686013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.687610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.689627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:29.701958 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1143/2311] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:35:29.706536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.715737 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8636ed-c5b7-473e-9651-c43a97c92122 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.720469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.721106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.721390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.721666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.722345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.724299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.763400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1169/2312] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:29 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:29.764829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.775836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d4aa-2845-46e9-b0c9-4f2c16072d04 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.831468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.832160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.832439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.832711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.833395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.835303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.854950 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1144/2313] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:29 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:29.859087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.869373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74131-d1f1-4120-86f1-e1d693acdde2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.874000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.874640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.874920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.875708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.876460 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.878065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.887891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1170/2314] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:29.892376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.902128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0250-3289-40e5-a76d-944a6500aeca admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.906767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.907342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.907618 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.907891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.908631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.910218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5fc4f-000a-4264-aae8-93f3ec36325b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.920454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1145/2315] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:29.924320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:29.933948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a2c39-1d36-40d6-a01e-9b09993b1922 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:29.938958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:29.939810 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.940117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.940393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] PATH_INFO: `/v3/projects/d9d1fa7decb542f5b56f340e0c165d82/users/aa64e0bc87c147dd9250410eb4449b37/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:29.955116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d1fa7decb542f5b56f340e0c165d82, user_id=aa64e0bc87c147dd9250410eb4449b37, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:29.957803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:29.970428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1171/2316] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:29 2022] PUT /identity/v3/projects/d9d1fa7decb542f5b56f340e0c165d82/users/aa64e0bc87c147dd9250410eb4449b37/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:29.980541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:29.980831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:29.981132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.010110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] MFA Rules not processed for user `aa64e0bc87c147dd9250410eb4449b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:30.011313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:30.074635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1146/2317] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:30.079322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.085340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:30.145811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68470-c050-4cf7-b396-169c504201e2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.150665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.151320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.151633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.151880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.152607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.155150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.184071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1172/2318] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:30 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:35:30.186630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.198363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a68b5-71e7-40e0-b9ad-0c7d681d5929 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.257655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.258322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.258605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.258880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.259582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.261551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.269180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:30.281678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1147/2319] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:30 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:30.285814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.296382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716650d-02c6-44d2-bf2e-0e9e6bd1bbb8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.301516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.302151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.302429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.302701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.303422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.305090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.316023 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1173/2320] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:30.319957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.330079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb7305-38e8-4fd3-b1e6-a8e50b135de5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.334738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.335598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.335880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.336206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] PATH_INFO: `/v3/projects/706870062c754c68ac1f03469c26e9e5/users/2c47ab69660a4b41b7497397bf162883/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.351478 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=706870062c754c68ac1f03469c26e9e5, user_id=2c47ab69660a4b41b7497397bf162883, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.354977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.368065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1148/2321] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:30 2022] PUT /identity/v3/projects/706870062c754c68ac1f03469c26e9e5/users/2c47ab69660a4b41b7497397bf162883/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:30.372160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.382252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42192aa5-0084-4458-a4df-8933dc3253af admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.438045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.438644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.438925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.439197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.439913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.441547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedd3c-f301-43dc-a0f0-582d419b1ceb admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.451049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1174/2322] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:30.455274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.465343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075a7f-ee1e-448c-abd0-902b463f9fbf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.470352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.471210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.471507 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.471759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] PATH_INFO: `/v3/projects/706870062c754c68ac1f03469c26e9e5/users/2c47ab69660a4b41b7497397bf162883/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.473758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706870062c754c68ac1f03469c26e9e5, user_id=2c47ab69660a4b41b7497397bf162883, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.476445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.487856 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1149/2323] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:30 2022] PUT /identity/v3/projects/706870062c754c68ac1f03469c26e9e5/users/2c47ab69660a4b41b7497397bf162883/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:30.498689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.498973 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.499267 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.525540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] MFA Rules not processed for user `2c47ab69660a4b41b7497397bf162883`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:30.526704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:30.588785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:30.593419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1175/2324] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:30.604534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:30.606194 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:30.662071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4363-a529-442c-8b02-121e5bb4f604 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:30.665792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:30.666418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:30.666694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:30.666966 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:30.676007 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:30.677453 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dab5c-4f52-4b3a-9a75-bbe068354ab9 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:30.687467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1150/2325] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:31.053628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:31.114374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ae4eb-50e6-44d8-919c-241c92c8d8e6 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:31.119054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:31.119910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:31.120216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:31.120487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] PATH_INFO: `/v3/users/aa64e0bc87c147dd9250410eb4449b37` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:31.121653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa64e0bc87c147dd9250410eb4449b37)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:31.123614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:31.167421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa64e0bc87c147dd9250410eb4449b37'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.168110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa64e0bc87c147dd9250410eb4449b37'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.175571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa64e0bc87c147dd9250410eb4449b37'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.182967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa64e0bc87c147dd9250410eb4449b37'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.183756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa64e0bc87c147dd9250410eb4449b37'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.200629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1176/2326] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:31 2022] DELETE /identity/v3/users/aa64e0bc87c147dd9250410eb4449b37 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:31.205328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:31.205800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:31.205896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:31.224258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:31.225501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:31.285603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1151/2327] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:31.295254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:31.296683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:31.353483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eae8ca-2f94-4893-9e37-14eea9420af6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:31.357257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:31.357913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:31.358197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:31.358470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:31.368679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:31.370137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:31.380113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1177/2328] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:35:31.649118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:31.650583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:31.663027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec5dce-1890-492e-a6c4-b74be90e6b7a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:31.667612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:31.668577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:31.668857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:31.669136 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] PATH_INFO: `/v3/projects/d9d1fa7decb542f5b56f340e0c165d82` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:31.670444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d1fa7decb542f5b56f340e0c165d82)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:31.673084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:31.719137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d1fa7decb542f5b56f340e0c165d82', 'request_id': 'req-a318c928-b34a-4fd2-8d97-7b38b97d2886'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.721510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:31.727172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d1fa7decb542f5b56f340e0c165d82', 'request_id': 'req-a318c928-b34a-4fd2-8d97-7b38b97d2886'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.732567 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d1fa7decb542f5b56f340e0c165d82', 'request_id': 'req-a318c928-b34a-4fd2-8d97-7b38b97d2886'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.746600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] The token cache is being invalidate because project d9d1fa7decb542f5b56f340e0c165d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:31.746883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.747518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.749093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1152/2329] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:31 2022] DELETE /identity/v3/projects/d9d1fa7decb542f5b56f340e0c165d82 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:31.753881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:31.763262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69340ac-0408-4a10-86dc-f8c5a7ec3032 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:31.781287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:31.822279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:31.823137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:31.823415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:31.823689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] PATH_INFO: `/v3/users/2c47ab69660a4b41b7497397bf162883` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:31.824897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c47ab69660a4b41b7497397bf162883)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:31.826819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:31.873616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c47ab69660a4b41b7497397bf162883'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.874248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c47ab69660a4b41b7497397bf162883'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.881178 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c47ab69660a4b41b7497397bf162883'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.888192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c47ab69660a4b41b7497397bf162883'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.888805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-598f84c5-3418-42ac-9544-8e1be7433b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c47ab69660a4b41b7497397bf162883'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:31.905495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1178/2330] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:31 2022] DELETE /identity/v3/users/2c47ab69660a4b41b7497397bf162883 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:32.172461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.173936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:32.188289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c928-b34a-4fd2-8d97-7b38b97d2886 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.248050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.248916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.249197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.249472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] PATH_INFO: `/v3/projects/706870062c754c68ac1f03469c26e9e5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.251325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=706870062c754c68ac1f03469c26e9e5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.253211 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.298887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706870062c754c68ac1f03469c26e9e5', 'request_id': 'req-ec5c9e0e-969e-4874-867b-3ce05a977e3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:32.305533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706870062c754c68ac1f03469c26e9e5', 'request_id': 'req-ec5c9e0e-969e-4874-867b-3ce05a977e3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:32.310979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706870062c754c68ac1f03469c26e9e5', 'request_id': 'req-ec5c9e0e-969e-4874-867b-3ce05a977e3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:32.322270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] The token cache is being invalidate because project 706870062c754c68ac1f03469c26e9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:32.322555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:32.323165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ec5c9e0e-969e-4874-867b-3ce05a977e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:32.324831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1153/2331] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:32 2022] DELETE /identity/v3/projects/706870062c754c68ac1f03469c26e9e5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:32.329682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.330166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.330287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.347812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:32.349061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:32.408013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1179/2332] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:32.415804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.416121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.416398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.434722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:32.435923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:32.444460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1154/2333] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:32.448498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.458705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0dc62-04c5-43d2-aa6c-9b0566f76636 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.463286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.463934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.464250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.464533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.465275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:35:32.465584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.467198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.478969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1180/2334] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:35:32.483171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.492802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04b09-8a1b-4192-8852-a31565d72cc7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.497388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.498013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.498290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.498560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.499234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.501790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.526701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1155/2335] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:32.530838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.540660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490f28-489d-4a6f-bca2-745f893cdc49 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.567604 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:32.600617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.601276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.601554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.602088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.602775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.604717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.626880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1181/2336] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:32.628996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.639260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2596-7eaf-4da0-8dfb-c0a68956b960 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.643953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.644739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.645026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.645305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.646026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.647628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.659086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1156/2337] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:32.663259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.674121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8666f-90c9-4797-b4aa-a7cdd832de79 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.679182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.679834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.680156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.680435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.681168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.682766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5301-568f-4b6a-848c-91cdfe735594 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.693287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1182/2338] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:32.697234 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.707210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a7e99-c5fe-4c0c-9fc3-af711416fa09 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.711836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.712735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.713019 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.713293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] PATH_INFO: `/v3/projects/f17f1cb9f3d34bf3be105b6691ce3882/users/3be758d2030f4bfa816b02a259b62a6b/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.729603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17f1cb9f3d34bf3be105b6691ce3882, user_id=3be758d2030f4bfa816b02a259b62a6b, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.732240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.745528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1157/2339] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:32 2022] PUT /identity/v3/projects/f17f1cb9f3d34bf3be105b6691ce3882/users/3be758d2030f4bfa816b02a259b62a6b/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:32.757081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.757371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.757647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.783884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] MFA Rules not processed for user `3be758d2030f4bfa816b02a259b62a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:32.785156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:32.850992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1183/2340] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:32.855842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.866525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:32.919451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091ec0-516e-4180-b253-7eca0c3543f8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:32.924768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:32.925412 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:32.925695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:32.925970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:32.926660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:32.928614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:32.952689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1158/2341] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:32.957793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:32.970074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307903-e6dc-47f2-9c44-d53e6ae31c0e None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.025017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.025605 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.025887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.026164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.026849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.028812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.048664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1184/2342] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:32 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:33.052731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:33.063123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e79-e8ee-48ea-baf7-09ff36877d90 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.067707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.068392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.068673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.068974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.069691 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.071290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.082368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1159/2343] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:33.086484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:33.096900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1300a1-37d4-4696-afc6-b2fbe0f7a674 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.101449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.102553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.102826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.103095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] PATH_INFO: `/v3/projects/fab6abd0fc414b84bedfc00f814b97d0/users/1ce05b815d8f45f483b9d48d7af3d61d/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.117802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab6abd0fc414b84bedfc00f814b97d0, user_id=1ce05b815d8f45f483b9d48d7af3d61d, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.120528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.132811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1185/2344] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:33 2022] PUT /identity/v3/projects/fab6abd0fc414b84bedfc00f814b97d0/users/1ce05b815d8f45f483b9d48d7af3d61d/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:33.136807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:33.147169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d749ca-3a1c-4925-a107-93b44d754a10 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.202104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.202760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.203041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.203810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.204645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.206245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a178b6-0740-4915-a2d7-937b24a61bae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.215929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1160/2345] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:33.220860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:33.226446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:33.233320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0137d-30a0-4add-95eb-c2058e035094 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.238288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.239147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.239425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.239692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] PATH_INFO: `/v3/projects/fab6abd0fc414b84bedfc00f814b97d0/users/1ce05b815d8f45f483b9d48d7af3d61d/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.241684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab6abd0fc414b84bedfc00f814b97d0, user_id=1ce05b815d8f45f483b9d48d7af3d61d, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.244377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.254717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1186/2346] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:33 2022] PUT /identity/v3/projects/fab6abd0fc414b84bedfc00f814b97d0/users/1ce05b815d8f45f483b9d48d7af3d61d/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:33.264827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.265238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.265448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.295036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] MFA Rules not processed for user `1ce05b815d8f45f483b9d48d7af3d61d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:33.296349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:33.368845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1161/2347] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:33.380540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:33.382264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:33.439897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e207a4-6c1e-49ee-833b-149a6ca32535 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:33.443484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:33.444160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:33.444445 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:33.444720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:33.454213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:33.455648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa6258-d1cc-49ba-b7a7-7f1c64af0d57 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:33.465065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1187/2348] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:34.762131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:34.766964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:34.826090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9856-731f-40ef-bc61-eca9443c94c8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:34.831043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:34.831900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:34.832216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:34.832494 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] PATH_INFO: `/v3/users/3be758d2030f4bfa816b02a259b62a6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:34.833666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be758d2030f4bfa816b02a259b62a6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:34.835622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:34.881628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be758d2030f4bfa816b02a259b62a6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:34.888331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be758d2030f4bfa816b02a259b62a6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:34.888993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be758d2030f4bfa816b02a259b62a6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:34.889600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be758d2030f4bfa816b02a259b62a6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:34.896994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be758d2030f4bfa816b02a259b62a6b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:34.913813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1162/2349] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:34 2022] DELETE /identity/v3/users/3be758d2030f4bfa816b02a259b62a6b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:34.918333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:34.918843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:34.918941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:34.936146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:34.937322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:34.997690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1188/2350] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:35.008337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:35.009817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:35.066426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6390f-f2c7-4efb-a3a3-2be2d0469d81 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:35.070433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:35.071146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:35.071425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:35.071699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:35.081374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:35.082732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:35.092293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1163/2351] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:35.353565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:35.355095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:35.368154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7188a-6bb0-46da-97fe-6c261db95a6d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:35.373073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:35.374028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:35.374377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:35.374719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] PATH_INFO: `/v3/projects/f17f1cb9f3d34bf3be105b6691ce3882` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:35.376594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17f1cb9f3d34bf3be105b6691ce3882)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:35.378927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:35.427378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17f1cb9f3d34bf3be105b6691ce3882', 'request_id': 'req-4bcfe176-5d8c-4918-96a9-66feb155602c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.432738 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17f1cb9f3d34bf3be105b6691ce3882', 'request_id': 'req-4bcfe176-5d8c-4918-96a9-66feb155602c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.441015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17f1cb9f3d34bf3be105b6691ce3882', 'request_id': 'req-4bcfe176-5d8c-4918-96a9-66feb155602c'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.451890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] The token cache is being invalidate because project f17f1cb9f3d34bf3be105b6691ce3882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:35.452201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.452811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.454689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1189/2352] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:35 2022] DELETE /identity/v3/projects/f17f1cb9f3d34bf3be105b6691ce3882 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:35.458765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:35.468441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eefc2-a9e3-4cc2-a980-e2b8fe9f388f service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:35.488432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:35.526664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:35.527622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:35.527903 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:35.528200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] PATH_INFO: `/v3/users/1ce05b815d8f45f483b9d48d7af3d61d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:35.529366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce05b815d8f45f483b9d48d7af3d61d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:35.531276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:35.576152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce05b815d8f45f483b9d48d7af3d61d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.583000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce05b815d8f45f483b9d48d7af3d61d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.583665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce05b815d8f45f483b9d48d7af3d61d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.584293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce05b815d8f45f483b9d48d7af3d61d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.591553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-12b518ad-0dec-443f-ac4b-cd9ecf6b9f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce05b815d8f45f483b9d48d7af3d61d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:35.610572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1164/2353] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:35 2022] DELETE /identity/v3/users/1ce05b815d8f45f483b9d48d7af3d61d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:35.881273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:35.883300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:35.899567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfe176-5d8c-4918-96a9-66feb155602c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:35.911846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:35.957932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:35.958781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:35.959060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:35.959331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] PATH_INFO: `/v3/projects/fab6abd0fc414b84bedfc00f814b97d0` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:35.960522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab6abd0fc414b84bedfc00f814b97d0)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:35.962413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.007054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab6abd0fc414b84bedfc00f814b97d0', 'request_id': 'req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:36.012639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab6abd0fc414b84bedfc00f814b97d0', 'request_id': 'req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:36.020368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab6abd0fc414b84bedfc00f814b97d0', 'request_id': 'req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:36.041843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] The token cache is being invalidate because project fab6abd0fc414b84bedfc00f814b97d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:36.042146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:36.042843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d1cac6b9-ed41-487b-ad9a-4ff2415802a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:36.044744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1190/2354] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:35 2022] DELETE /identity/v3/projects/fab6abd0fc414b84bedfc00f814b97d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:36.049468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.049979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.050142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.069624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:36.070902 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:36.132527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1165/2355] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:36.140542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.141582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.141861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.162616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:36.164679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:36.173824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1191/2356] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:35:36.178328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.188342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebf244-5b2d-467d-8d42-2c3fede7f8ab None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.193016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.193672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.193951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.194222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.194949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:35:36.195252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.196917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.209254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1166/2357] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:35:36.213837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.224201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7744aa-8310-4ad6-afe5-0d9f303a94ab None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.230021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.230681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.230968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.231246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.231952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.233931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.261602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1192/2358] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:36.266500 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.276713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2bf0b-2f76-4d9d-a4cc-d42d3e697c96 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.307804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:36.339068 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.339741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.340047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.340328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.341026 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.342947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.366355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1167/2359] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:35:36.370498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.381667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32781a-aebb-40e3-833e-d84392e3d669 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.386575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.387107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.387390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.387667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.388551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.390156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.401071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1193/2360] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:36.404946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.414862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e682-5705-4ad7-9fa1-aabe35520d6a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.419603 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.420278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.420554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.420964 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.421683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.423289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fed71-1735-4a2a-99e2-6dadcfde0c1a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.433417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1168/2361] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:36.438325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.448655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5544c-a7be-4570-9b03-c390bb9d5004 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.453413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.454774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.455050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.455319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] PATH_INFO: `/v3/projects/608062eabef8472c86260dc8d00d0a6d/users/e1f0088573aa42a88509f3e59dab8de8/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.470198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=608062eabef8472c86260dc8d00d0a6d, user_id=e1f0088573aa42a88509f3e59dab8de8, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.472924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.486093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1194/2362] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:36 2022] PUT /identity/v3/projects/608062eabef8472c86260dc8d00d0a6d/users/e1f0088573aa42a88509f3e59dab8de8/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:36.497556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.497844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.498119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.524717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] MFA Rules not processed for user `e1f0088573aa42a88509f3e59dab8de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:36.525904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:36.588615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1169/2363] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:36.593048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.639087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:36.659130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2948b-0233-477f-acef-ce19776945aa admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.663942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.664633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.664914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.665186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.665880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.667821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.693370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1195/2364] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:35:36.697443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.708574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794b7b-9f2b-4bcc-9f40-ff127565d2cd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.763945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.764640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.764923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.765198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.765908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.767844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.787696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1170/2365] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:36 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:36.791727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.802559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27158-669c-4c97-aafc-fc483dbe8340 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.807154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.807800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.808112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.808390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.809113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.810742 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.823547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1196/2366] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:36.827609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.837461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819d7c-4d23-4e5a-a805-867906605e19 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.842063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.842926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.843205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.843506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] PATH_INFO: `/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7/users/b76c65b226674a669caaf732943b79a4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.858291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea12ba34b04b05bb5dc51a6f72b5b7, user_id=b76c65b226674a669caaf732943b79a4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.861476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.873457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1171/2367] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:36 2022] PUT /identity/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7/users/b76c65b226674a669caaf732943b79a4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:36.877876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.897473 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96414d4-d583-4cba-87b6-ec57b4ded91b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.952323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.952981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.953262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.953537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.954256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.955861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5468c-c3bc-4886-8c24-1cd269a3ec14 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:36.965543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1197/2368] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:36.969837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:36.976899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:36.981173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd720a-9cb0-439c-a486-50e9ddbea522 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:36.987571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:36.988483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:36.988760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:36.989058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] PATH_INFO: `/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7/users/b76c65b226674a669caaf732943b79a4/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:36.991043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea12ba34b04b05bb5dc51a6f72b5b7, user_id=b76c65b226674a669caaf732943b79a4, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:36.993746 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:37.004451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1172/2369] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:36 2022] PUT /identity/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7/users/b76c65b226674a669caaf732943b79a4/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:35:37.014261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:37.014550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:37.014828 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:37.040352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] MFA Rules not processed for user `b76c65b226674a669caaf732943b79a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:37.041553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:37.110610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1198/2370] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:37.121245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:37.123021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:37.179337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3761093-ea2f-46a9-abe7-c964fef9d7dd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:37.182877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:37.183503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:37.183783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:37.184082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:37.240158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:37.241599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:37.250404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1173/2371] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:41.396066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:41.397529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:41.409684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16762c8f-6b12-426f-b382-82a63d4b517c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:41.413170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:41.413896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:41.414174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:41.414447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:41.423208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:41.424669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25e59-9eb7-43ce-9aa8-ee9349ddd03a service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:41.433927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1199/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:46.275377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:46.336248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a772a6-7a53-40ee-a3ef-18cfcc4c1eac service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:46.340777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:46.341633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:46.341914 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:46.342189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] PATH_INFO: `/v3/users/e1f0088573aa42a88509f3e59dab8de8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:46.343362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f0088573aa42a88509f3e59dab8de8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:46.345338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:46.390575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f0088573aa42a88509f3e59dab8de8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.391758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:46.400633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f0088573aa42a88509f3e59dab8de8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.401568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f0088573aa42a88509f3e59dab8de8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.402189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f0088573aa42a88509f3e59dab8de8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.409185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f0088573aa42a88509f3e59dab8de8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.426451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1174/2373] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:46 2022] DELETE /identity/v3/users/e1f0088573aa42a88509f3e59dab8de8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:46.431055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:46.431541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:46.431654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:46.450191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:46.451640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:46.471721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:46.515612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1200/2374] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:46.525481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:46.526868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:46.588099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725693e4-6fdc-4156-8199-c4f8f87502f2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:46.591930 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:46.592633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:46.592874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:46.593146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:46.602961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:46.604452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:46.614655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1175/2375] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:46.880457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:46.881903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:46.893803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b4c5-31a9-43b6-9e9d-bd0b9dd5e15d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:46.898584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:46.899437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:46.899711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:46.899981 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] PATH_INFO: `/v3/projects/608062eabef8472c86260dc8d00d0a6d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:46.901195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608062eabef8472c86260dc8d00d0a6d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:46.903217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:46.950373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608062eabef8472c86260dc8d00d0a6d', 'request_id': 'req-4d67da3f-822a-4622-8833-fa4c65d2c551'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.955880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608062eabef8472c86260dc8d00d0a6d', 'request_id': 'req-4d67da3f-822a-4622-8833-fa4c65d2c551'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.964886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608062eabef8472c86260dc8d00d0a6d', 'request_id': 'req-4d67da3f-822a-4622-8833-fa4c65d2c551'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.976474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] The token cache is being invalidate because project 608062eabef8472c86260dc8d00d0a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:46.977011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.977639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:46.979201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1201/2376] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:46 2022] DELETE /identity/v3/projects/608062eabef8472c86260dc8d00d0a6d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:46.983138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:46.993348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f848f7-bfa7-4d67-896c-f30c7c2d05c5 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.048268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.049670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.049946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.050217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] PATH_INFO: `/v3/users/b76c65b226674a669caaf732943b79a4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.051388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76c65b226674a669caaf732943b79a4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.053347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.098530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76c65b226674a669caaf732943b79a4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.105493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76c65b226674a669caaf732943b79a4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.106151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76c65b226674a669caaf732943b79a4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.106757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76c65b226674a669caaf732943b79a4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.120161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e39e3d47-fd6b-4d3a-99f9-7fb7bae1cca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76c65b226674a669caaf732943b79a4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.126206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:47.140340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1176/2377] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:46 2022] DELETE /identity/v3/users/b76c65b226674a669caaf732943b79a4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:47.427709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.429201 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:47.444035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67da3f-822a-4622-8833-fa4c65d2c551 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.508513 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.509368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.509641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.509962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] PATH_INFO: `/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.511092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea12ba34b04b05bb5dc51a6f72b5b7)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.513681 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.569101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea12ba34b04b05bb5dc51a6f72b5b7', 'request_id': 'req-e83cb2ae-f18d-4086-92ba-9666944a6e30'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.570662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:47.587409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea12ba34b04b05bb5dc51a6f72b5b7', 'request_id': 'req-e83cb2ae-f18d-4086-92ba-9666944a6e30'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.597831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea12ba34b04b05bb5dc51a6f72b5b7', 'request_id': 'req-e83cb2ae-f18d-4086-92ba-9666944a6e30'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.613999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] The token cache is being invalidate because project 1dea12ba34b04b05bb5dc51a6f72b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:47.614353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.615009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e83cb2ae-f18d-4086-92ba-9666944a6e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:47.616758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1202/2378] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:47 2022] DELETE /identity/v3/projects/1dea12ba34b04b05bb5dc51a6f72b5b7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:47.622768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.623615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.623615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.643434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:47.644672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:47.707329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1177/2379] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:35:47.715640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.715926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.716238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.734698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:47.735885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:47.744481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1203/2380] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:47.748604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.758186 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dcbbc-b516-45c5-a9ac-55125dfbf0ce None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.762786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.763422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.763701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.763976 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.764732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:35:47.765034 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.766630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.777944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1178/2381] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:35:47.782171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.791789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafabd87-e2bb-4fe2-907a-5a0de1746f30 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.796367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.797002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.797280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.797550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.798230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.800689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.825364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1204/2382] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:47 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:47.829129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.838787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e613-77c9-4fad-9570-e64592177c6b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.894825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.895485 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.895764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.896065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.896764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.898700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.919296 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1179/2383] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:47 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:47.923297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.933869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb50d-7812-43f5-86ba-f5cbd125dea0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.938523 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.939171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.939456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.939731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.940497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.942104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.952313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1205/2384] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:47.956643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.966371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1482-63c8-4b0d-8a80-4d66d2b4bd9d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:47.971565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:47.972237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:47.972517 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:47.972793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:47.973647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:47.975285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a406-ce6a-4886-bf76-b62a04a2afa2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:47.985366 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1180/2385] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:47.989403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:47.999296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe9325-6b01-4383-9e9e-676d0b008287 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:48.004000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:48.004894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:48.005176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:48.005450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] PATH_INFO: `/v3/projects/a13459e42d8d43a0ae83fea93e2cc961/users/1e98c02f5f7648aead813c885e85a8e1/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:48.021320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13459e42d8d43a0ae83fea93e2cc961, user_id=1e98c02f5f7648aead813c885e85a8e1, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:48.023971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:48.037731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1206/2386] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:47 2022] PUT /identity/v3/projects/a13459e42d8d43a0ae83fea93e2cc961/users/1e98c02f5f7648aead813c885e85a8e1/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:48.049760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:48.050069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:48.050348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:48.077058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] MFA Rules not processed for user `1e98c02f5f7648aead813c885e85a8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:48.078261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:48.120047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:48.144581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1181/2387] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:48.155836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:48.157521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:48.213145 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb551b01-6b18-40d1-855a-bb75a309c893 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:48.217403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:48.218121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:48.218462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:48.218826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:48.228921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:48.230374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47404b-d063-454d-9025-5354a6ac97c7 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:48.239225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1207/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:51.219974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:51.284322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f32c6-1b9a-4708-bccd-b87a8e3e6050 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:51.289001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:51.289869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:51.290178 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:51.290499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] PATH_INFO: `/v3/users/1e98c02f5f7648aead813c885e85a8e1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:51.291694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e98c02f5f7648aead813c885e85a8e1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:51.293670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:51.338858 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e98c02f5f7648aead813c885e85a8e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.346229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e98c02f5f7648aead813c885e85a8e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.346893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e98c02f5f7648aead813c885e85a8e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.347499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e98c02f5f7648aead813c885e85a8e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.355126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e98c02f5f7648aead813c885e85a8e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.372701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1182/2389] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:35:51 2022] DELETE /identity/v3/users/1e98c02f5f7648aead813c885e85a8e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:35:51.377529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:51.378005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:51.378100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:51.394464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:51.395637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:51.453988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1208/2390] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:35:51.463459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:51.464872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:51.520731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b106b-b776-49fe-ae66-ba652a7eac54 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:51.524348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:51.524979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:51.525290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:51.525568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:51.534956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:51.536424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380ea7-1562-4797-9bf2-ab43e3f185c2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:51.545681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1183/2391] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:51.804849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:51.806352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:51.822484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2d029-f0a7-4af2-a67a-f0c3d2005091 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:51.827357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:51.828475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:51.829012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:51.829338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] PATH_INFO: `/v3/projects/a13459e42d8d43a0ae83fea93e2cc961` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:51.831547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13459e42d8d43a0ae83fea93e2cc961)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:51.833980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:51.849819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:51.888598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13459e42d8d43a0ae83fea93e2cc961', 'request_id': 'req-31d6eb0d-064d-482d-bb62-9ad82b755b65'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.895675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13459e42d8d43a0ae83fea93e2cc961', 'request_id': 'req-31d6eb0d-064d-482d-bb62-9ad82b755b65'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.902940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13459e42d8d43a0ae83fea93e2cc961', 'request_id': 'req-31d6eb0d-064d-482d-bb62-9ad82b755b65'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.914472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] The token cache is being invalidate because project a13459e42d8d43a0ae83fea93e2cc961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:35:51.914755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.915452 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-31d6eb0d-064d-482d-bb62-9ad82b755b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:35:51.919237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1209/2392] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:35:51 2022] DELETE /identity/v3/projects/a13459e42d8d43a0ae83fea93e2cc961 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:51.921839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:51.922123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:51.922426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:51.929780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:51.941804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:51.943002 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:52.000767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1184/2393] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:35:52.008376 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.008665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.008944 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.027424 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:52.028631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:52.036906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1210/2394] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:52.041053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.050771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca208b1-cb7f-4b86-bbee-3edac8e537ef None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.055358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.056051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.056340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.056636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.057484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:35:52.058096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.059581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.071604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1185/2395] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:35:52.075847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.085637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728884-94e6-4c9e-bdb1-24631e035289 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.090294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.090933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.091213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.091488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.092204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.094115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.120659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1211/2396] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:52.124843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.135247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb340-b699-4eaf-99e5-6fecd445ec86 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.193290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.193877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.194158 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.194433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.195142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.197105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.219990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1186/2397] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:52.223789 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.234439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e12277-5b9f-49cf-886c-44526bcd03b5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.239157 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.239942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.240246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.240517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.241238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.242896 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.253945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1212/2398] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:52.257973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.268678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de19b8-8418-4891-9b5f-fd77abcdcaba admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.273645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.274338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.274620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.274892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.275614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.277262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c15e3c-6e32-463e-82f3-60c1fe0aceae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.288514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1187/2399] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:52.293097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.303426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeac7d-178f-4de7-a869-add35d964bcf admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.316802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.316802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.316802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.316802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] PATH_INFO: `/v3/projects/50f5b5f492754e26a404e52cb418d4cd/users/6098a6dedb1145ba89ca40c7d83fbd8f/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.327198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f5b5f492754e26a404e52cb418d4cd, user_id=6098a6dedb1145ba89ca40c7d83fbd8f, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.330637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.344646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1213/2400] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:52 2022] PUT /identity/v3/projects/50f5b5f492754e26a404e52cb418d4cd/users/6098a6dedb1145ba89ca40c7d83fbd8f/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:52.356543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.356839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.357139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.385872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] MFA Rules not processed for user `6098a6dedb1145ba89ca40c7d83fbd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:52.387124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:52.450385 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:52.454493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1188/2401] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:52.459559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.524846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94340c-1ed6-4855-a298-59597bd0fbe2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.530535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.531194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.531565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.531743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.532458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.534451 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.566020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1214/2402] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:52.570096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.590443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dbd0-50c1-489e-a2f7-c148bf3cc4b6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.646742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.647432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.647716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.647989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.648708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.650635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.674610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1189/2403] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:35:52.675920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.686358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c69dc-9358-46e0-afa8-d0a79ced1d1a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.691574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.692418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.692702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.692978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.693709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.695397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.710149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1215/2404] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:52.711228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.721524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f527b-42bc-4f1a-9dfe-ed2999fb3daa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.726282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.727203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.728304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.728599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.729377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.731039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3ea1-4ef9-4ed6-84cf-84bbb396e58b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.741657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1190/2405] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:52.745775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.755927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254dc6a-d347-490b-9ab4-6060b653f152 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.760655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.761524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.761803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.762072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] PATH_INFO: `/v3/projects/c96ff0d4d6654e7eb7dc6f9089c20cb3/users/bffec97d5e0b419cabe0298d5d0ad70c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.771106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:52.778840 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ff0d4d6654e7eb7dc6f9089c20cb3, user_id=bffec97d5e0b419cabe0298d5d0ad70c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.782332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:52.796465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1216/2406] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:52 2022] PUT /identity/v3/projects/c96ff0d4d6654e7eb7dc6f9089c20cb3/users/bffec97d5e0b419cabe0298d5d0ad70c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:35:52.806685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.807065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.807405 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.835398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] MFA Rules not processed for user `bffec97d5e0b419cabe0298d5d0ad70c`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:52.836689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:52.909191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1191/2407] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:52.913585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:52.976548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf47a-053a-4608-91ad-ca9eada46fc2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:52.981669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:52.982325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:52.982609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:52.982888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:52.983578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:52.985535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.015477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1217/2408] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:53.016666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.027685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02f7e-fc86-4daa-ac4f-f65309cea06b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.085948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.086634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.086927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.087209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.087905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.089926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.105741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:53.116247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.124175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1192/2409] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:35:53 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:35:53.128332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb5b0-cb1d-49b3-9f7a-70064c1a0416 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.134234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.135032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.135374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.135708 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.136542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.138326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.151499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1218/2410] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:35:53.155611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.169033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41719ef-2d3d-4f43-81d0-ea2cd9b00279 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.174379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.175297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.175581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.175857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] PATH_INFO: `/v3/projects/89a079f73934454082ea2aca6974a8b6/users/a74aaa24aa584571910de245db6e50c6/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.193993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a079f73934454082ea2aca6974a8b6, user_id=a74aaa24aa584571910de245db6e50c6, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.196839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.218534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1193/2411] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:53 2022] PUT /identity/v3/projects/89a079f73934454082ea2aca6974a8b6/users/a74aaa24aa584571910de245db6e50c6/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:35:53.219494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.232446 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182172-6274-47bd-870f-f1caae6a71ef admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.308122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.309186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.309661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.310139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.311068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.312956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f81b06-329d-45bd-8970-6773f21609ba admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.329896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.332769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1219/2412] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:35:53.342713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cd9-3eb5-4c79-8aeb-4f925f4ee815 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.348357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.349742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.350221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.350709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] PATH_INFO: `/v3/projects/89a079f73934454082ea2aca6974a8b6/users/a74aaa24aa584571910de245db6e50c6/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.353325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a079f73934454082ea2aca6974a8b6, user_id=a74aaa24aa584571910de245db6e50c6, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.356424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.380010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.380534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.380919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.382426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1194/2413] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:35:53 2022] PUT /identity/v3/projects/89a079f73934454082ea2aca6974a8b6/users/a74aaa24aa584571910de245db6e50c6/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:35:53.413413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] MFA Rules not processed for user `a74aaa24aa584571910de245db6e50c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:53.414746 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:53.462589 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:35:53.497407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1220/2414] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:35:53.509430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:53.511140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:53.576273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ba04-ba72-418d-8816-05deac2d8997 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:53.581663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:53.582423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:53.582784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:53.583151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:53.664548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:53.667141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:53.681742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1195/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:35:55.235959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:55.238045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:55.251471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb900ce-55dd-4a8b-a333-370caf91bbde None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:55.255800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:55.257115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:55.257621 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:55.258053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:55.335679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:55.337275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11e375-70de-4f18-bf4d-f9711aeefa0f service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:55.348062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1221/2416] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:56.009367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:35:56.018965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e667079-7c42-4067-bada-f5c5a2ef7284 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:35:56.022708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:35:56.023358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:56.023634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:56.023905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:56.033843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:35:56.035286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:35:56.046460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1196/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:35:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:35:56.882359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76770-12cc-4de3-b7b8-22b18a7d9be8 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:35:56.882912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76770-12cc-4de3-b7b8-22b18a7d9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:35:56.883034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76770-12cc-4de3-b7b8-22b18a7d9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:35:56.900642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b7f76770-12cc-4de3-b7b8-22b18a7d9be8 None None] MFA Rules not processed for user `d39a17af7fa84627b4d3e6543000ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:35:56.901834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b7f76770-12cc-4de3-b7b8-22b18a7d9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:35:56.955411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1222/2418] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:00.016571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:00.079241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d949-05cb-4cf5-8cb6-ddaa4aa3f23a service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:00.084534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:00.085577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:00.085816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:00.086363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] PATH_INFO: `/v3/users/6098a6dedb1145ba89ca40c7d83fbd8f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:00.087582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6098a6dedb1145ba89ca40c7d83fbd8f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:00.089570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:00.092115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:00.156067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6098a6dedb1145ba89ca40c7d83fbd8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.168501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6098a6dedb1145ba89ca40c7d83fbd8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.169268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6098a6dedb1145ba89ca40c7d83fbd8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.169999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6098a6dedb1145ba89ca40c7d83fbd8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.183307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6098a6dedb1145ba89ca40c7d83fbd8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.211767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1197/2419] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:36:00 2022] DELETE /identity/v3/users/6098a6dedb1145ba89ca40c7d83fbd8f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:00.215855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:00.216568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:00.216568 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:00.239017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:00.240531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:00.315150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1223/2420] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:36:00.321324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:00.322780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:00.383859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62ae29-09bf-4ad1-bedf-86faae9919e9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:00.387787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:00.388564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:00.388848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:00.389129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:00.399469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:00.400962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:00.411093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1198/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:36:00.839849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:00.841348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:00.853259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaa601-886b-4fad-b91d-86a71cced6c4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:00.857763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:00.859113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:00.859113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:00.859113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] PATH_INFO: `/v3/projects/50f5b5f492754e26a404e52cb418d4cd` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:00.860367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f5b5f492754e26a404e52cb418d4cd)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:00.862784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:00.889750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:00.914601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f5b5f492754e26a404e52cb418d4cd', 'request_id': 'req-cf628447-809b-4374-9bfd-3428aaf255cf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.920096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f5b5f492754e26a404e52cb418d4cd', 'request_id': 'req-cf628447-809b-4374-9bfd-3428aaf255cf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.929106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f5b5f492754e26a404e52cb418d4cd', 'request_id': 'req-cf628447-809b-4374-9bfd-3428aaf255cf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.941150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] The token cache is being invalidate because project 50f5b5f492754e26a404e52cb418d4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:36:00.941553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.942180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:00.943914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1224/2422] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:36:00 2022] DELETE /identity/v3/projects/50f5b5f492754e26a404e52cb418d4cd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:00.947817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:00.957375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d7d45-6599-4473-8c73-bdaa0edc0d70 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:01.024553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:01.025467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:01.025747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:01.026102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] PATH_INFO: `/v3/users/bffec97d5e0b419cabe0298d5d0ad70c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:01.027240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffec97d5e0b419cabe0298d5d0ad70c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:01.029248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:01.059244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:01.080817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffec97d5e0b419cabe0298d5d0ad70c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.087495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffec97d5e0b419cabe0298d5d0ad70c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.088551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffec97d5e0b419cabe0298d5d0ad70c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.089249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffec97d5e0b419cabe0298d5d0ad70c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.097816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffec97d5e0b419cabe0298d5d0ad70c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.116318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1199/2423] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:36:00 2022] DELETE /identity/v3/users/bffec97d5e0b419cabe0298d5d0ad70c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:01.383715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:01.385238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:01.401651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628447-809b-4374-9bfd-3428aaf255cf admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:01.458336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:01.459187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:01.459465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:01.459736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] PATH_INFO: `/v3/projects/c96ff0d4d6654e7eb7dc6f9089c20cb3` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:01.460942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96ff0d4d6654e7eb7dc6f9089c20cb3)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:01.462950 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:01.511202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96ff0d4d6654e7eb7dc6f9089c20cb3', 'request_id': 'req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.516611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96ff0d4d6654e7eb7dc6f9089c20cb3', 'request_id': 'req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.525058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96ff0d4d6654e7eb7dc6f9089c20cb3', 'request_id': 'req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.536901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] The token cache is being invalidate because project c96ff0d4d6654e7eb7dc6f9089c20cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:36:01.537186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.537834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.539593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1225/2424] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:36:01 2022] DELETE /identity/v3/projects/c96ff0d4d6654e7eb7dc6f9089c20cb3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:01.543328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:01.544738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:01.557370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eeb44-a604-4008-9e2b-163001a0d826 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:01.615319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:01.616226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:01.616505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:01.616777 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] PATH_INFO: `/v3/users/a74aaa24aa584571910de245db6e50c6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:01.617959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74aaa24aa584571910de245db6e50c6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:01.619886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:01.666716 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74aaa24aa584571910de245db6e50c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.673568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74aaa24aa584571910de245db6e50c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.674224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74aaa24aa584571910de245db6e50c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.674826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74aaa24aa584571910de245db6e50c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.682192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c27df05-4c9e-4dcc-97f9-27337fe40e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74aaa24aa584571910de245db6e50c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:01.699797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1200/2425] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:36:01 2022] DELETE /identity/v3/users/a74aaa24aa584571910de245db6e50c6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:01.967187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:01.968609 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:01.982121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098455f8-c504-4f4c-9bf5-0b7ffffbe6aa admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.023657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:02.044069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.044949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.045229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.045502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] PATH_INFO: `/v3/projects/89a079f73934454082ea2aca6974a8b6` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.046686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a079f73934454082ea2aca6974a8b6)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.049237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.094439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a079f73934454082ea2aca6974a8b6', 'request_id': 'req-a4834416-00cb-4e1b-8367-45b6dc977c8a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:02.100438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a079f73934454082ea2aca6974a8b6', 'request_id': 'req-a4834416-00cb-4e1b-8367-45b6dc977c8a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:02.108645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a079f73934454082ea2aca6974a8b6', 'request_id': 'req-a4834416-00cb-4e1b-8367-45b6dc977c8a'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:02.120221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] The token cache is being invalidate because project 89a079f73934454082ea2aca6974a8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:36:02.120506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:02.121130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a4834416-00cb-4e1b-8367-45b6dc977c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:36:02.122654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1226/2426] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:36:01 2022] DELETE /identity/v3/projects/89a079f73934454082ea2aca6974a8b6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:36:02.127646 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.128193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.128292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.146645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:02.147843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:02.164886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:02.224175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1201/2427] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:02.274544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.274836 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.275115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.296036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:02.297250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:02.305263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1227/2428] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:36:02.309808 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.319570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b8d26-7a0c-4833-8dda-5249b92895a5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.324299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.325086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.325437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.325783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.326611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:36:02.326996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.328692 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.341202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1202/2429] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:36:02.345966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.355322 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ab9b3-99d1-4df6-bf1b-876cf9e3e8f3 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.359959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.360627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.360930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.361203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.361878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.363821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.388080 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1228/2430] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:36:02 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:36:02.392923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.403079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7720e06-ecf7-4305-b6d6-dc203ee4db6d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.458408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.459063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.459346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.459625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.460339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.462269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.482596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1203/2431] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:36:02 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:36:02.486902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.497398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bad61-412d-4cb6-941e-4a0f7599b616 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.502028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.502667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.502946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.503215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.503931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.505563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.515736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1229/2432] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:36:02.520248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.530142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b9f6-88d9-4b7b-adbb-1e59f291f8c4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.535497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.536184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.536465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.536736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.537452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.539083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc5e4d-4253-4e5a-bc66-8a22c2c467e6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.549042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1204/2433] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:36:02.552948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.562629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2c88-874d-421d-95aa-da667110a9b9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.567617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.568506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.568777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.569043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] PATH_INFO: `/v3/projects/94a2ff800a064d2e9f17b9f79b698b9a/users/475ec07f624d4d32a4e3d94e92234a33/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.588538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a2ff800a064d2e9f17b9f79b698b9a, user_id=475ec07f624d4d32a4e3d94e92234a33, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.591447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.606607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1230/2434] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:36:02 2022] PUT /identity/v3/projects/94a2ff800a064d2e9f17b9f79b698b9a/users/475ec07f624d4d32a4e3d94e92234a33/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:36:02.612955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56d8f-c53e-4c22-b8ef-37879792b600 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.613331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56d8f-c53e-4c22-b8ef-37879792b600 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.613640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56d8f-c53e-4c22-b8ef-37879792b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.631299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8df56d8f-c53e-4c22-b8ef-37879792b600 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:02.632541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8df56d8f-c53e-4c22-b8ef-37879792b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:02.693370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1205/2435] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:02.708524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:02.710240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:02.770047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607475-8cfd-475e-99e5-881f219cf373 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:02.773564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:02.774204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:02.774488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:02.774761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:02.784062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:02.785502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:02.794832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1231/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:36:03.407375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13d4e-1e8c-4edd-85a9-93c9d01251a4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:03.407992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13d4e-1e8c-4edd-85a9-93c9d01251a4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:03.408333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13d4e-1e8c-4edd-85a9-93c9d01251a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:03.438215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b8d13d4e-1e8c-4edd-85a9-93c9d01251a4 None None] MFA Rules not processed for user `475ec07f624d4d32a4e3d94e92234a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:03.440352 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b8d13d4e-1e8c-4edd-85a9-93c9d01251a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:03.463371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:03.531967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1206/2437] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:03.541398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:03.544007 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:03.558467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:03.626216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a795ad-a515-451b-959a-923c6cba633e service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:03.630478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:03.630900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:03.631230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:03.631458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:03.642660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:03.644194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:03.654062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1232/2438] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:36:05.048511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93cd3-7b87-42ba-a533-d678026627f5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:05.049024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93cd3-7b87-42ba-a533-d678026627f5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:05.049109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93cd3-7b87-42ba-a533-d678026627f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:05.066620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0de93cd3-7b87-42ba-a533-d678026627f5 None None] MFA Rules not processed for user `475ec07f624d4d32a4e3d94e92234a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:05.067798 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0de93cd3-7b87-42ba-a533-d678026627f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:05.074638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1207/2439] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:10.670198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:10.671928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:10.762685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e1ec-7156-4fe4-a2de-7c95f768e4f9 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:10.768834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:10.771008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:10.771297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:10.771574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:10.773575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:10.787567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:10.789482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:10.801325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1233/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:36:15.060759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=22 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:18.600923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89954d-9553-4d18-a295-1956543a4eee None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:18.601849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89954d-9553-4d18-a295-1956543a4eee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:18.602677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89954d-9553-4d18-a295-1956543a4eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:18.636810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dd89954d-9553-4d18-a295-1956543a4eee None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:18.637900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dd89954d-9553-4d18-a295-1956543a4eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:18.698482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1208/2441] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:36:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:18.754638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:18.756263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:18.835196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794a234-2573-4b5a-bc19-35976d7501bf service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:18.840507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:18.841382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:18.841757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:18.842149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:18.852106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:18.853710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2183f8-8db2-4a0f-96b9-1dc622b8d958 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:18.862068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1234/2442] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:36:28.691653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=25 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:28.858648 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=88 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:38.520225 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.520835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.520835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.522434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1209/2443] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:36:38.528162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698070-b18d-45a3-a428-674dcd9c5428 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.528654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698070-b18d-45a3-a428-674dcd9c5428 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.528774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698070-b18d-45a3-a428-674dcd9c5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.547273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f1698070-b18d-45a3-a428-674dcd9c5428 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:38.548596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f1698070-b18d-45a3-a428-674dcd9c5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:38.557945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1235/2444] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:36:38.570560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:38.572353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:38.643251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288fb01-7dad-42ce-991f-b87085418284 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:38.647249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:38.647884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.648193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.648464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.659546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:38.660992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0341b-1570-40a3-88a5-b831fdd6569d service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:38.671904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1210/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:36:38.738037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.738353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.738643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] PATH_INFO: `/` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.740100 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1236/2446] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:36:38.745514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063721-aab1-431f-9971-85e1bf5dcd88 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.745799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063721-aab1-431f-9971-85e1bf5dcd88 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.746095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063721-aab1-431f-9971-85e1bf5dcd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.763925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a4063721-aab1-431f-9971-85e1bf5dcd88 None None] MFA Rules not processed for user `d505d66500da43eab82b746d7e7d0875`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:38.765133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a4063721-aab1-431f-9971-85e1bf5dcd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:38.771602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1211/2447] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:38.782820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:38.785077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:38.798018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc42a-085f-48c9-a815-d6f49c290d90 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:38.802186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:38.802817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:38.803098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:38.803373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:38.810411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:38.811846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d196d-c6e8-496c-8c18-2114d76b4bb7 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:38.819548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1237/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:36:39.137579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede847ae-a241-499a-929e-2f846562168d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:39.137863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede847ae-a241-499a-929e-2f846562168d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:39.138132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede847ae-a241-499a-929e-2f846562168d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:39.139559 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1212/2449] 10.222.0.13 () {54 vars in 921 bytes} [Fri Jun 24 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:36:39.144914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd03e1-6d5b-4f9e-a506-910b880595a0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:39.145206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd03e1-6d5b-4f9e-a506-910b880595a0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:39.145486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd03e1-6d5b-4f9e-a506-910b880595a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:39.163331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9fbd03e1-6d5b-4f9e-a506-910b880595a0 None None] MFA Rules not processed for user `0e00c4684e0645eaa796aa1765f7481e`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:39.164543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9fbd03e1-6d5b-4f9e-a506-910b880595a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:39.173622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1238/2450] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Jun 24 14:36:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:39.185255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede847ae-a241-499a-929e-2f846562168d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:39.196592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede847ae-a241-499a-929e-2f846562168d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:39.200042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:39.200665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:39.200946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:39.201219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:39.211144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:39.212616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:39.224467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1213/2451] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:36:41.068031 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:41.068497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:41.068597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:41.086238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:36:41.087498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:36:41.094560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1239/2452] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:36:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:36:41.106384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:36:41.117922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290148-1721-4add-9aac-90b5d9b832b0 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:36:41.122806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:36:41.123427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:36:41.123705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:36:41.123977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:36:41.132552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:36:41.134128 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f05758-d195-4964-b0a3-c88221608806 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:36:41.142066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1214/2453] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:36:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:36:51.081262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=15 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:36:51.138862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=41 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:01.486291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:01.495667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84151-c202-48ad-b1c8-1beb6f2e86e2 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:01.499448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:01.500136 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:01.500423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:01.500699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:01.502467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:01.564614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:01.566423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:01.576319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1240/2454] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:04.122730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80644-7cb3-426f-bf14-f2ade5be67e9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:04.123860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80644-7cb3-426f-bf14-f2ade5be67e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:04.124335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80644-7cb3-426f-bf14-f2ade5be67e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:04.146306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4dc80644-7cb3-426f-bf14-f2ade5be67e9 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:04.147519 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4dc80644-7cb3-426f-bf14-f2ade5be67e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:04.156144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1215/2455] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:04.214947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:04.217064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:04.236875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec12a-038c-44d7-8e6c-199c00e18fed service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:04.244909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:04.245562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:04.245839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:04.246112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:04.254760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:04.256383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:04.266112 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1241/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:07.362093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5658ab-ffe2-4ef8-9ba7-1852d8ca1882 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:07.362589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5658ab-ffe2-4ef8-9ba7-1852d8ca1882 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:07.362704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5658ab-ffe2-4ef8-9ba7-1852d8ca1882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:07.380908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fd5658ab-ffe2-4ef8-9ba7-1852d8ca1882 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:07.382874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fd5658ab-ffe2-4ef8-9ba7-1852d8ca1882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:07.389883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1216/2457] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:07.401894 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:07.413097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad7ed-f15b-4b3c-843b-6424be007da2 service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:07.418220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:07.418844 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:07.419122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:07.419391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:07.427435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:07.429683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:07.437740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1242/2458] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:37:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:37:10.223881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:10.224357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:10.224481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:10.244160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:10.245377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:10.253431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1217/2459] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:10.290407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:10.302804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b58c-9b03-441f-9e96-bd55415af257 service swift] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:10.308558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:10.309194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:10.309482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:10.309760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:10.318045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:10.319687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d107bc-532d-495c-b82b-8c8d01e41b2d service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:10.329301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1243/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:14.526940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:14.536475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62ddd-39d2-4ac1-af61-654431787ce7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:14.542013 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:14.542795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:14.543083 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:14.543369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:14.546254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:14.559537 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:14.561050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:14.571365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1218/2461] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:15.587181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:15.587721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:15.587721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:15.610045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:15.611309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:15.620126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1244/2462] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:15.642744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:15.656137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8b68-2a56-4ac6-998b-e5f6c55d6f9d service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:15.661462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:15.662088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:15.662952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:15.663239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:15.671943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:15.673573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c8592-d246-4383-bc4d-658f294a8ccc service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:15.683403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1219/2463] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:17.449454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:17.450969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:17.570710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48937c-6a95-4a6b-97b1-3e2f5d401784 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:17.576098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:17.576923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:17.577382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:17.577811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:17.579900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:17.596974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:17.598590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:17.609913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1245/2464] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:19.736927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:19.737894 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:19.738381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:19.760137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:19.763196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:19.774114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1220/2465] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:37:19.797580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:19.812760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1556-1383-4884-a30d-1521282abfc5 service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:19.818027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:19.818701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:19.818985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:19.819263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:19.828311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:19.829922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:19.841488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1246/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:20.957723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:20.959212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:20.972174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355caa3-096f-4e3e-a512-943806c3848c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:20.978514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:20.979598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:20.979960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:20.980390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] PATH_INFO: `/v3/users/4161564548194bf395ad7efa112af26e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:20.981779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4161564548194bf395ad7efa112af26e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:20.983909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:21.031205 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4161564548194bf395ad7efa112af26e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.040762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4161564548194bf395ad7efa112af26e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.041427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4161564548194bf395ad7efa112af26e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.042048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4161564548194bf395ad7efa112af26e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.049069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4161564548194bf395ad7efa112af26e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.066566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1221/2467] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:20 2022] DELETE /identity/v3/users/4161564548194bf395ad7efa112af26e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:21.234693 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:21.245258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448416-8916-47fc-8239-9b4c5ad07045 service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:21.275138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:21.309898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:21.310779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:21.311055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:21.311326 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] PATH_INFO: `/v3/projects/8e49baadf26b4287854b3c6de905bf72` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:21.312538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e49baadf26b4287854b3c6de905bf72)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:21.314628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:21.361802 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e49baadf26b4287854b3c6de905bf72', 'request_id': 'req-47cb050e-55cf-4617-9f74-3e2462583f41'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.367946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e49baadf26b4287854b3c6de905bf72', 'request_id': 'req-47cb050e-55cf-4617-9f74-3e2462583f41'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.376101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e49baadf26b4287854b3c6de905bf72', 'request_id': 'req-47cb050e-55cf-4617-9f74-3e2462583f41'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.388574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] The token cache is being invalidate because project 8e49baadf26b4287854b3c6de905bf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:21.388985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.389729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.391279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1247/2468] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:21 2022] DELETE /identity/v3/projects/8e49baadf26b4287854b3c6de905bf72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:21.395254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:21.397408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:21.410510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e04e-ec50-47a5-ab91-5babc70b18c0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:21.468339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:21.469212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:21.469492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:21.469764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] PATH_INFO: `/v3/users/936a34134f4a4e10942561f3f4802f94` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:21.477375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=936a34134f4a4e10942561f3f4802f94)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:21.479347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:21.502939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:21.530905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936a34134f4a4e10942561f3f4802f94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.538035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936a34134f4a4e10942561f3f4802f94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.538749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936a34134f4a4e10942561f3f4802f94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.539362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936a34134f4a4e10942561f3f4802f94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.546731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936a34134f4a4e10942561f3f4802f94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.565601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1222/2469] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:21 2022] DELETE /identity/v3/users/936a34134f4a4e10942561f3f4802f94 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:21.744432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:21.748846 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:21.762594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb050e-55cf-4617-9f74-3e2462583f41 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:21.823166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:21.824239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:21.824575 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:21.824917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] PATH_INFO: `/v3/projects/c46fac233a884b42b796034660159c04` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:21.826116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46fac233a884b42b796034660159c04)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:21.828068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:21.876350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46fac233a884b42b796034660159c04', 'request_id': 'req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.882580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46fac233a884b42b796034660159c04', 'request_id': 'req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.885773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:21.896868 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46fac233a884b42b796034660159c04', 'request_id': 'req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.909694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] The token cache is being invalidate because project c46fac233a884b42b796034660159c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:21.909997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.910631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-f91d70bd-8441-46bf-a3b1-cab24c1f0e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:21.912733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1248/2470] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:21 2022] DELETE /identity/v3/projects/c46fac233a884b42b796034660159c04 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:23.020483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:23.022758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:23.104709 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94c91-e2c4-456c-8936-022253114ded admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:23.175295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:23.176244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:23.176634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:23.177022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:23.180196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:23.201085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:23.202736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:23.221181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1223/2471] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:23.934644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0e16-e563-46d5-9cc8-d9e1f0a4582e None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:23.935185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0e16-e563-46d5-9cc8-d9e1f0a4582e None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:23.935461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0e16-e563-46d5-9cc8-d9e1f0a4582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:23.954197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-76ac0e16-e563-46d5-9cc8-d9e1f0a4582e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:23.955497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-76ac0e16-e563-46d5-9cc8-d9e1f0a4582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:24.020243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1249/2472] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:24.042589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:24.044210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:24.080587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:24.123882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfec1-0f59-48eb-9df5-923dc5707f0f service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:24.129531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:24.130190 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:24.130502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:24.130771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:24.141596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:24.143176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:24.152674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1224/2473] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:37:28.120945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:28.121436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:28.121619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:28.139419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:28.140638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:28.148585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1250/2474] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:28.170079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:28.171447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:28.187401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a1ffd-3596-40f1-b68f-fa5c7f37849c service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:28.193060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:28.193693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:28.193975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:28.194252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:28.202492 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:28.204177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:28.213945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1225/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:28.382874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:28.384285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:28.443125 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad7a44-f747-4190-8970-3a984f04391a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:28.446706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:28.447345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:28.447630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:28.447910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:28.449740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:28.461901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:28.463331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:28.472856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1251/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:31.550818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:31.552931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:31.567100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b18b-e5f7-4540-88b3-1961506335a4 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:31.572542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:31.573401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:31.573683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:31.573955 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] PATH_INFO: `/v3/users/9f8192ea4a174253afcebaf6f9d206c9` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:31.575145 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8192ea4a174253afcebaf6f9d206c9)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:31.577123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:31.624422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8192ea4a174253afcebaf6f9d206c9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.631273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8192ea4a174253afcebaf6f9d206c9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.631951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8192ea4a174253afcebaf6f9d206c9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.632590 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8192ea4a174253afcebaf6f9d206c9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.639829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8637cd14-9f57-4f12-9001-ec6a64ad2adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8192ea4a174253afcebaf6f9d206c9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.657703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1226/2477] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:31 2022] DELETE /identity/v3/users/9f8192ea4a174253afcebaf6f9d206c9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:31.829560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:31.845399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5034ec-8e35-4eb0-b8b2-c5826bd87eaa service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:31.906440 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:31.907296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:31.907579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:31.907882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] PATH_INFO: `/v3/projects/aeb6d5b470a24eb9aa3951b7bc53bdae` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:31.909097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb6d5b470a24eb9aa3951b7bc53bdae)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:31.911002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:31.943287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:31.959517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb6d5b470a24eb9aa3951b7bc53bdae', 'request_id': 'req-62a59ce0-3a49-4235-8b07-a71f03f60755'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.965009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb6d5b470a24eb9aa3951b7bc53bdae', 'request_id': 'req-62a59ce0-3a49-4235-8b07-a71f03f60755'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.971818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb6d5b470a24eb9aa3951b7bc53bdae', 'request_id': 'req-62a59ce0-3a49-4235-8b07-a71f03f60755'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.983562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] The token cache is being invalidate because project aeb6d5b470a24eb9aa3951b7bc53bdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:31.983843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.984500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-62a59ce0-3a49-4235-8b07-a71f03f60755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:31.986032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1252/2478] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:31 2022] DELETE /identity/v3/projects/aeb6d5b470a24eb9aa3951b7bc53bdae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:31.991681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:31.991979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:31.992288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.009939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:32.011039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:32.069809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1227/2479] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:32.077528 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.077817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.078095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.096826 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:32.098257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:32.107222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1253/2480] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:32.111300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.120896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e367-ba46-4fe6-a3dd-d0891722ed6d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.125427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.126066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.126342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.126613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.127502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:37:32.127890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.129512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.147033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1228/2481] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:37:32.147510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.157587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bd1fb-4287-43c3-9291-97262fbff753 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.163171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.163964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.164350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.164710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.165476 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.167487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.198715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1254/2482] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:37:32.203373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.212539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:32.234288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd014-cb10-438d-a34c-536f5ab57cb0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.313126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.314045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.314458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.314797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.315546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.317693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.342221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1229/2483] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:32.345927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.356805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2d60-9451-4ffd-83f2-a7ed9ca609ce admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.365934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.366602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.366990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.367149 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.367881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.369561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.380961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1255/2484] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:32.385111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.395322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312223e-5c46-4af9-a07a-eeb68f76a246 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.400846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.401504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.401785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.402060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.402783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.404439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b468d9-bf5d-42d4-9622-0b860d73e7a0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.414796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1230/2485] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:32.419194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.430821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ddb7-e12e-4259-b634-74405a7874f5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.436279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.437154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.437434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.437706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] PATH_INFO: `/v3/projects/db8312e687694925b3c02cdae0dc31fc/users/b9288fe0b2c546089187a92509f820cc/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.456791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8312e687694925b3c02cdae0dc31fc, user_id=b9288fe0b2c546089187a92509f820cc, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.460375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.476009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1256/2486] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:32 2022] PUT /identity/v3/projects/db8312e687694925b3c02cdae0dc31fc/users/b9288fe0b2c546089187a92509f820cc/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:37:32.486985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.487281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.487562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.518608 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] MFA Rules not processed for user `b9288fe0b2c546089187a92509f820cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:32.519861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:32.585126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1231/2487] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:32.589537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.650536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e82e-23ea-4f2e-b264-e344c5ae83f5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.655188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.655830 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.656135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.656407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.657089 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.658983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.684646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1257/2488] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:37:32.688611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.699005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab27d5-ece8-4ea5-b8eb-91342e2bab59 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.754540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.755200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.755482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.755757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.756488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.758445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.774629 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:32.782578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1232/2489] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:32.783775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.794487 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2fa7-060a-444a-bc18-14a6bae973d7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.799393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.800108 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.800397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.800673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.801405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.803264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.813985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1258/2490] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:32.818045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.827853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b96a1-5538-4f4f-af1d-0c609b78d54b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.832462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.833354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.834138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.834437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] PATH_INFO: `/v3/projects/4a086a20d69b404892e18b8d52f54771/users/9ca2dca86f9c4c51a51dc051547d0332/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.850417 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a086a20d69b404892e18b8d52f54771, user_id=9ca2dca86f9c4c51a51dc051547d0332, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.853431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.866246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1233/2491] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:32 2022] PUT /identity/v3/projects/4a086a20d69b404892e18b8d52f54771/users/9ca2dca86f9c4c51a51dc051547d0332/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:37:32.870230 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.880334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2e803-da0c-4afd-96b7-3ef57c7d2a64 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.903861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:32.937420 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.938076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.938357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.938635 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.939357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.940990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9e03d-59ff-4ced-bc66-cc194765d2ef admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.950540 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1259/2492] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:32.954704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:32.965355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125bb0-2564-42f6-a142-d5fc714f18da admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:32.969948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:32.970805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.971089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.971365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] PATH_INFO: `/v3/projects/4a086a20d69b404892e18b8d52f54771/users/9ca2dca86f9c4c51a51dc051547d0332/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:32.973373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a086a20d69b404892e18b8d52f54771, user_id=9ca2dca86f9c4c51a51dc051547d0332, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:32.976927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:32.986999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1234/2493] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:32 2022] PUT /identity/v3/projects/4a086a20d69b404892e18b8d52f54771/users/9ca2dca86f9c4c51a51dc051547d0332/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:32.997134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:32.997547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:32.997891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:33.024923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] MFA Rules not processed for user `9ca2dca86f9c4c51a51dc051547d0332`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:33.026073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:33.096879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1260/2494] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:33.109470 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:33.111199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:33.168900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15449e4-44dd-402a-9496-590f8a07832e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:33.172578 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:33.173215 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:33.173495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:33.173770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:33.183309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:33.184717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:33.194788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1235/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:33.238408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:33.250317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f152d-9b26-457e-a79f-771e8b053553 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:33.255067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:33.256417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:33.256700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:33.257197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:33.322744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:33.324285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945f3f-0a3a-4f7c-b571-2f15785417a3 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:33.334462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1261/2496] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:36.616545 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:36.686582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6aaef-e56a-49d4-80e7-a0db2c7f4d93 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:36.691432 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:36.692464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:36.692809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:36.693272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] PATH_INFO: `/v3/users/b9288fe0b2c546089187a92509f820cc` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:36.694544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9288fe0b2c546089187a92509f820cc)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:36.696621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:36.747421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9288fe0b2c546089187a92509f820cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:36.754271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9288fe0b2c546089187a92509f820cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:36.754937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9288fe0b2c546089187a92509f820cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:36.755582 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9288fe0b2c546089187a92509f820cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:36.763090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9288fe0b2c546089187a92509f820cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:36.767718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:36.784593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1236/2497] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:36 2022] DELETE /identity/v3/users/b9288fe0b2c546089187a92509f820cc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:36.789480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:36.789933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:36.790055 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:36.807285 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:36.808694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:36.854062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:36.875101 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1262/2498] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:36.885170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:36.886569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:36.942511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95be29-e777-41c8-b5e8-ec1e3b614e52 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:36.946818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:36.947446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:36.947729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:36.948005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:36.956953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:36.958407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:36.968631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1237/2499] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:37.236997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:37.238432 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:37.256886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2775b1-b4a7-42e4-881b-4380c6360bcb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:37.264397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:37.265275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:37.265559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:37.265857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] PATH_INFO: `/v3/projects/db8312e687694925b3c02cdae0dc31fc` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:37.267590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8312e687694925b3c02cdae0dc31fc)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:37.269583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:37.318599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8312e687694925b3c02cdae0dc31fc', 'request_id': 'req-49d93337-b0d3-4914-a163-d3aee9bf10d2'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.325219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8312e687694925b3c02cdae0dc31fc', 'request_id': 'req-49d93337-b0d3-4914-a163-d3aee9bf10d2'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.336542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8312e687694925b3c02cdae0dc31fc', 'request_id': 'req-49d93337-b0d3-4914-a163-d3aee9bf10d2'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.352292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] The token cache is being invalidate because project db8312e687694925b3c02cdae0dc31fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:37.352583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.353246 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.354831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1263/2500] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:37 2022] DELETE /identity/v3/projects/db8312e687694925b3c02cdae0dc31fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:37.358963 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:37.369153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d314ea-12e7-471e-9155-b2975df075b7 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:37.426996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:37.428581 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:37.428862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:37.429134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] PATH_INFO: `/v3/users/9ca2dca86f9c4c51a51dc051547d0332` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:37.430295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca2dca86f9c4c51a51dc051547d0332)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:37.432249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:37.476927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca2dca86f9c4c51a51dc051547d0332'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.483660 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca2dca86f9c4c51a51dc051547d0332'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.484344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca2dca86f9c4c51a51dc051547d0332'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.484936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca2dca86f9c4c51a51dc051547d0332'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.494472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-29b93456-b624-4c97-8398-3347948ad386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca2dca86f9c4c51a51dc051547d0332'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.514005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1238/2501] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:37 2022] DELETE /identity/v3/users/9ca2dca86f9c4c51a51dc051547d0332 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:37.779956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:37.781374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:37.794980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93337-b0d3-4914-a163-d3aee9bf10d2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:37.852164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:37.853020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:37.853298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:37.853572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] PATH_INFO: `/v3/projects/4a086a20d69b404892e18b8d52f54771` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:37.854731 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a086a20d69b404892e18b8d52f54771)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:37.856690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:37.900084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a086a20d69b404892e18b8d52f54771', 'request_id': 'req-b8b4923e-3f8c-4795-839c-ea298cbd09b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.905364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a086a20d69b404892e18b8d52f54771', 'request_id': 'req-b8b4923e-3f8c-4795-839c-ea298cbd09b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.912771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a086a20d69b404892e18b8d52f54771', 'request_id': 'req-b8b4923e-3f8c-4795-839c-ea298cbd09b4'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.921411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:37.925775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] The token cache is being invalidate because project 4a086a20d69b404892e18b8d52f54771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:37.926011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.926815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-b8b4923e-3f8c-4795-839c-ea298cbd09b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:37.929655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1264/2502] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:37 2022] DELETE /identity/v3/projects/4a086a20d69b404892e18b8d52f54771 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:37.935390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:37.935849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:37.935965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:37.948181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:37.954587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:37.956431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:38.014207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1239/2503] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:37:38.022990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.023281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.023562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.042043 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:38.043338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:38.051071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1265/2504] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:38.055426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.065077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e9dec-7852-44e1-89a7-ca9d9006bc24 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.069566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.070204 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.070481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.070748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.071460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:37:38.071757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.073395 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.085099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1240/2505] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:37:38.089173 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.098271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e05ca-4889-47a3-b60c-f040059f589a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.103771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.104462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.104743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.105015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.105697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.107600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.133934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1266/2506] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:38.137923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.148373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cee96-4c03-43cd-8d0d-7ae70b4f63f0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.201991 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.202564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.202841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.203113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.203789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.205740 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.227509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1241/2507] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:38.231682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.241893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7338af9-7155-4771-9aec-2a5a2d31aaaf admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.246668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.247347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.247634 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.247909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.248678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.250291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.263744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1267/2508] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:38.267248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.277688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855706b-6996-4f7e-b5b9-78e9d5afc98b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.282270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.282939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.283217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.283490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.284240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.285831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394edfd-9bb7-4e0a-847b-a6ff4662c5df admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.296302 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1242/2509] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:37:38.300202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.310226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531eb6-45b1-4e05-99cb-2fd7f3758d68 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.314922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.315827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.316160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.316484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] PATH_INFO: `/v3/projects/e564db9135a2401baf76c1e9b1c650ef/users/2ba415e998ce4314a4b6b75d9a5279e0/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.331415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e564db9135a2401baf76c1e9b1c650ef, user_id=2ba415e998ce4314a4b6b75d9a5279e0, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.334666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.347485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1268/2510] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:38 2022] PUT /identity/v3/projects/e564db9135a2401baf76c1e9b1c650ef/users/2ba415e998ce4314a4b6b75d9a5279e0/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:38.359383 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.359671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.359944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.385925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] MFA Rules not processed for user `2ba415e998ce4314a4b6b75d9a5279e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:38.387109 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:38.450708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1243/2511] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:38.455195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.517644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c17c-379d-4861-af3c-43447fbc460a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.523042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.523702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.523986 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.524426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.525141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.527219 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.556233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1269/2512] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:38.557351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.563101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:38.570628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadab41-358b-4ea7-934b-20e684e1f020 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.627586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.628308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.628595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.628873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.629556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.632058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.652324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1244/2513] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:38.656308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.666665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e460e3-e8e6-460b-ba96-a22a84561922 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.671573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.672260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.672545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.672820 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.673552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.675164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.685774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1270/2514] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:38.689889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.700402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495acc-c403-4290-bfbf-cb82308ae3e3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.705014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.706131 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.706272 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.706541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] PATH_INFO: `/v3/projects/c6d60f93bc744834b06da70674aa342c/users/7352698799774cd2810863144894d2e1/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.721864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d60f93bc744834b06da70674aa342c, user_id=7352698799774cd2810863144894d2e1, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.724571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.737031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1245/2515] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:38 2022] PUT /identity/v3/projects/c6d60f93bc744834b06da70674aa342c/users/7352698799774cd2810863144894d2e1/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:38.741414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.751222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a06ab-3dba-4d78-9da4-4d1102191ab4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.807218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.807927 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.808228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.808507 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.809228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.810827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338152f7-a665-43da-9aec-c12dca65204b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.821083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1271/2516] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:38.825310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.835801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd856cf-bcdf-42d9-b6bf-0bb36ee886fd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:38.840414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:38.841274 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.841550 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.841823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] PATH_INFO: `/v3/projects/c6d60f93bc744834b06da70674aa342c/users/7352698799774cd2810863144894d2e1/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.843766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d60f93bc744834b06da70674aa342c, user_id=7352698799774cd2810863144894d2e1, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:38.846447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:38.856768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1246/2517] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:38 2022] PUT /identity/v3/projects/c6d60f93bc744834b06da70674aa342c/users/7352698799774cd2810863144894d2e1/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:38.867240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:38.867533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:38.867812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:38.880012 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:38.895005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] MFA Rules not processed for user `7352698799774cd2810863144894d2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:38.896293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:38.964899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1272/2518] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:38.976562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:38.978329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:39.034087 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fb494-2d38-4e5a-9a11-7d2955c83d9a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:39.037745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:39.038363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:39.038645 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:39.038916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:39.049004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:39.050450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:39.061761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1247/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:39.146590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:39.157036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dcae2-2121-48c4-a5c4-d1b1d1d51cdb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:39.160939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:39.162118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:39.162457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:39.162801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:39.226878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:39.228381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1864-2b60-4d8c-806c-0f41260d8b91 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:39.237692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1273/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:43.970306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:44.030475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:44.034867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd26f7-600e-48a1-94d8-7d87c662b1ed service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:44.041077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:44.041937 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.042220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.042493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] PATH_INFO: `/v3/users/2ba415e998ce4314a4b6b75d9a5279e0` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.043655 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba415e998ce4314a4b6b75d9a5279e0)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:44.045663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:44.090142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba415e998ce4314a4b6b75d9a5279e0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.096789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba415e998ce4314a4b6b75d9a5279e0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.097444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba415e998ce4314a4b6b75d9a5279e0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.098050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba415e998ce4314a4b6b75d9a5279e0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.106107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba415e998ce4314a4b6b75d9a5279e0'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.124111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1248/2521] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:43 2022] DELETE /identity/v3/users/2ba415e998ce4314a4b6b75d9a5279e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:44.128602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefaf-c08c-4c33-a387-37422c7dabf0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.129060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefaf-c08c-4c33-a387-37422c7dabf0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.129155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efefaf-c08c-4c33-a387-37422c7dabf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.147472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b9efefaf-c08c-4c33-a387-37422c7dabf0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:44.148705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b9efefaf-c08c-4c33-a387-37422c7dabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:44.211561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1274/2522] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:44.221240 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:44.222636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:44.285721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358034d1-2953-4fad-a30f-162c62445fa5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:44.290033 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:44.290678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.290959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.291322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.300657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:44.302088 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:44.313303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1249/2523] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:44.344579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.344788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.345066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.363239 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] MFA Rules not processed for user `475ec07f624d4d32a4e3d94e92234a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:44.364483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:44.391227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:44.422627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1275/2524] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:44.588527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:44.589979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:44.613708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1539-55e5-4be4-a28e-3803564e6942 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:44.623818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:44.624723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.625005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.625284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] PATH_INFO: `/v3/projects/e564db9135a2401baf76c1e9b1c650ef` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.626502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e564db9135a2401baf76c1e9b1c650ef)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:44.628469 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:44.686203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e564db9135a2401baf76c1e9b1c650ef', 'request_id': 'req-e6f0526b-46ac-46ea-8f16-166353a21abe'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.694271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e564db9135a2401baf76c1e9b1c650ef', 'request_id': 'req-e6f0526b-46ac-46ea-8f16-166353a21abe'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.700304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e564db9135a2401baf76c1e9b1c650ef', 'request_id': 'req-e6f0526b-46ac-46ea-8f16-166353a21abe'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.712848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] The token cache is being invalidate because project e564db9135a2401baf76c1e9b1c650ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:44.713134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.713792 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.715356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1250/2525] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:44 2022] DELETE /identity/v3/projects/e564db9135a2401baf76c1e9b1c650ef => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:44.719232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:44.729928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4111-cbdb-4e06-a324-10ae63ac4332 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:44.786736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:44.787782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:44.788103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:44.788386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] PATH_INFO: `/v3/users/7352698799774cd2810863144894d2e1` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:44.789834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7352698799774cd2810863144894d2e1)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:44.791792 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:44.843382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7352698799774cd2810863144894d2e1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.844104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7352698799774cd2810863144894d2e1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.851753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7352698799774cd2810863144894d2e1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.860142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7352698799774cd2810863144894d2e1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.860786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bb3adcc9-aa56-42d4-bc82-dbfb019da2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7352698799774cd2810863144894d2e1'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:44.879961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1276/2526] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:44 2022] DELETE /identity/v3/users/7352698799774cd2810863144894d2e1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:37:45.193067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.194577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:45.202450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:45.210971 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0526b-46ac-46ea-8f16-166353a21abe admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.286770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.288206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.288483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.288750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] PATH_INFO: `/v3/projects/c6d60f93bc744834b06da70674aa342c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.289928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d60f93bc744834b06da70674aa342c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.291828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.339941 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d60f93bc744834b06da70674aa342c', 'request_id': 'req-92c08cb2-43ff-475d-b7f0-cb4d453294ab'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:45.348173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d60f93bc744834b06da70674aa342c', 'request_id': 'req-92c08cb2-43ff-475d-b7f0-cb4d453294ab'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:45.358876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d60f93bc744834b06da70674aa342c', 'request_id': 'req-92c08cb2-43ff-475d-b7f0-cb4d453294ab'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:45.372949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] The token cache is being invalidate because project c6d60f93bc744834b06da70674aa342c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:45.373300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:45.374096 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-92c08cb2-43ff-475d-b7f0-cb4d453294ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:45.375744 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1251/2527] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:45 2022] DELETE /identity/v3/projects/c6d60f93bc744834b06da70674aa342c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:45.380999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.381494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.381599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.401281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:45.402491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:45.454849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:45.471651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1277/2528] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:45.480270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.480554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.480831 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.498844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:45.500063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:45.507864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1252/2529] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:45.512256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.522808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb562c23-ea6e-4f11-a8a8-0e5b8a0b68d1 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.527488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.528254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.528602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.528887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.529654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:37:45.529946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.531695 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.544380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1278/2530] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:37:45.548788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.558292 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea40a-1eba-41d7-b4ed-4bea8f835dbe None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.563308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.563970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.564283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.564560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.565246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.567270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.597028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1253/2531] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:45.601666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.612252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d647-cab3-46e3-a477-687629e8ace8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.669549 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.670200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.670478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.670748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.671435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.673594 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.692611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1279/2532] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:45 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:45.696701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.706975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e983-e14a-4364-a621-4b021d97545b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.712142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.712786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.713147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.713426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.714144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.715765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.727119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1254/2533] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:45.730946 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.740778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c260-2e23-4d1d-a0e4-d3e6e163a43c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.745502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.746139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.746417 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.746687 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.747433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.749050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6c151-db26-4930-84f8-5be06944d2b7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.758758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1280/2534] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:45.762676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.772954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7ff3-41ad-43f8-897e-00e95d1741fd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.777527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.778386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.778666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.778939 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] PATH_INFO: `/v3/projects/819299cc733e494f8b4535d488b1ca55/users/48162b64f46c44638e7db2ae4ece210b/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.793714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819299cc733e494f8b4535d488b1ca55, user_id=48162b64f46c44638e7db2ae4ece210b, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:45.796414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:45.808807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1255/2535] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:45 2022] PUT /identity/v3/projects/819299cc733e494f8b4535d488b1ca55/users/48162b64f46c44638e7db2ae4ece210b/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:45.820270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.820566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.820845 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:45.850856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] MFA Rules not processed for user `48162b64f46c44638e7db2ae4ece210b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:45.852370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:45.917591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1281/2536] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:45.928862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:45.931306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:45.964665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:45.993130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff21cb-509e-47b4-a7e3-9c52eeb09aa0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:45.997236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:45.997884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:45.998169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:45.998454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.009166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:46.011065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf14ff8-dd49-448b-b22a-961289c5e4d1 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:46.022124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1256/2537] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:37:46.046553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:46.113144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:46.130328 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8d1d-cf0c-4577-abc1-2c69312324d7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:46.136304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:46.137465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.137864 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.138610 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] PATH_INFO: `/v3/users/48162b64f46c44638e7db2ae4ece210b` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.139924 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48162b64f46c44638e7db2ae4ece210b)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:46.142261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:46.208008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48162b64f46c44638e7db2ae4ece210b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.208686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48162b64f46c44638e7db2ae4ece210b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.216413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48162b64f46c44638e7db2ae4ece210b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.226852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48162b64f46c44638e7db2ae4ece210b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.227474 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48162b64f46c44638e7db2ae4ece210b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.247102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1282/2538] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:46 2022] DELETE /identity/v3/users/48162b64f46c44638e7db2ae4ece210b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:46.251570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.252073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.252174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.269535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:46.270862 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:46.335364 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1257/2539] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:37:46.345135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:46.346563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:46.410374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75936-5137-4da0-b739-2492f9084294 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:46.414669 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:46.415314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.415596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.415872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.424977 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:46.426360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e4bc-8ad7-4d2c-bc5c-2f8e67e382ac service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:46.439613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1283/2540] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:37:46.718576 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:46.721355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:46.736503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afe78c-5789-4e4d-9b95-805eff1f3426 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:46.742842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:46.744121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.744408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.744687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] PATH_INFO: `/v3/projects/819299cc733e494f8b4535d488b1ca55` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.745893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819299cc733e494f8b4535d488b1ca55)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:46.747800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:46.797070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819299cc733e494f8b4535d488b1ca55', 'request_id': 'req-54c10086-8b2a-45b9-8041-88363248b106'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.807699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819299cc733e494f8b4535d488b1ca55', 'request_id': 'req-54c10086-8b2a-45b9-8041-88363248b106'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.813555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819299cc733e494f8b4535d488b1ca55', 'request_id': 'req-54c10086-8b2a-45b9-8041-88363248b106'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.824795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] The token cache is being invalidate because project 819299cc733e494f8b4535d488b1ca55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:46.825073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.825725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-54c10086-8b2a-45b9-8041-88363248b106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:46.827260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1258/2541] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:46 2022] DELETE /identity/v3/projects/819299cc733e494f8b4535d488b1ca55 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:46.832202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.832439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.832702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.851785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:46.853017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:46.912520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1284/2542] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:46.920495 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.920806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.921082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.940321 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:46.941460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:46.949529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1259/2543] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:46.953754 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:46.964805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c48b-db41-4017-8d63-1c5064ed169c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:46.969597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:46.970257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:46.970544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:46.970819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:46.971564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:37:46.971852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:46.973557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:46.983570 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:46.990902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1285/2544] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:37:46.992616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.002220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee764eb5-1ee9-4881-a9d0-194bb3284ec7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.007051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.007731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.007985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.008293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.008979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.010901 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.038207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1260/2545] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:46 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:47.042165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.052763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa8d3-d457-4f74-9669-55f056db2720 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.111461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.112341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.112730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.113535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.113899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.116626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.140065 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1286/2546] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:37:47.144148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.155466 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0415267-81a8-444f-b0f4-c18c40d5214d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.160170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.160826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.161110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.161389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.162148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.163758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.174482 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1261/2547] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:47.179008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.189121 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01038718-9224-4b21-b831-15a015f10368 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.194717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.195387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.196068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.196068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.196728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.198357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fb564-54e8-4aaa-872c-0d0166ca4729 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.216347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1287/2548] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:47.218244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.231212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe6cd0-e99f-4958-a2bc-c4af9d2c445c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.236227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.237123 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.237407 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.237687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] PATH_INFO: `/v3/projects/884479adca2d4f75b227c9dc0a5787a2/users/3c319e0574aa497abeedbb5b08a70bc1/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.253588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:47.257428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=884479adca2d4f75b227c9dc0a5787a2, user_id=3c319e0574aa497abeedbb5b08a70bc1, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.260144 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.274893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1262/2549] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:47 2022] PUT /identity/v3/projects/884479adca2d4f75b227c9dc0a5787a2/users/3c319e0574aa497abeedbb5b08a70bc1/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:47.284928 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.285209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.285485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.312247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] MFA Rules not processed for user `3c319e0574aa497abeedbb5b08a70bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:47.313468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:47.379952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1288/2550] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:47.384951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.456917 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78edb6-35d7-4550-8226-7e3f8154ff2a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.470653 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.471329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.471607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.471880 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.472671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.474625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.502873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1263/2551] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:47.504258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.515466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b00eb6-f3a0-450e-baf0-8cdaf90d8d9f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.574677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.575377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.575655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.575929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.576664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.578638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.595504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:47.603280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1289/2552] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:47.607634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.618995 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16556c8-b2fd-4393-ae4c-f2e078ac9cd6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.624228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.624956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.625305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.625755 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.626580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.628342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.639252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1264/2553] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:47.643202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.653632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff86-4b19-441a-b7e8-cd066f89df93 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.666740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.667500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.667785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.668091 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.668824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.670448 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12611-f4bd-43b9-97f4-72895c10254a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.681839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1290/2554] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:47.686705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.698915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942ccc-56d4-47b8-8ebf-a46c62700c25 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.703541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.704465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.704747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.705020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] PATH_INFO: `/v3/projects/ca78fe40bee04fefbf735f521f983c79/users/2758055aaa224c2687f114fb1cdc955c/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.720199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca78fe40bee04fefbf735f521f983c79, user_id=2758055aaa224c2687f114fb1cdc955c, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.722876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.736944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1265/2555] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:47 2022] PUT /identity/v3/projects/ca78fe40bee04fefbf735f521f983c79/users/2758055aaa224c2687f114fb1cdc955c/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:47.747975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.748286 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.748562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.776066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] MFA Rules not processed for user `2758055aaa224c2687f114fb1cdc955c`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:47.777278 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:47.843529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1291/2556] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:47.848810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.913260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99522-5f07-4720-ba84-c20b4fa3a825 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:47.917875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:47.918526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:47.918807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:47.919080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:47.919762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:47.921748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:47.946441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1266/2557] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:47.950522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:47.961690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882280a5-a87f-4e21-bf11-aa6616092403 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.017522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.018295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.018583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.018856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.019536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.022052 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.041808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1292/2558] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:47 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:48.045863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:48.055865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05bfd1-d23d-4add-9c61-abb2a597ad5d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.060414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.061056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.061334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.061606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.062322 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.063943 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.074793 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1267/2559] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:48.078762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:48.089399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde163a-f557-4dc9-87d7-814b62bed8ff admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.093974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.094835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.095118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.095392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] PATH_INFO: `/v3/projects/8d5078bba5f64e3780a18ad03f2018a0/users/8066a40321c347e19f0420fea9b022be/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.110551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5078bba5f64e3780a18ad03f2018a0, user_id=8066a40321c347e19f0420fea9b022be, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.113264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.125984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1293/2560] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:48 2022] PUT /identity/v3/projects/8d5078bba5f64e3780a18ad03f2018a0/users/8066a40321c347e19f0420fea9b022be/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:48.129834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:48.141121 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1be65-cdfb-468b-be6d-e645116c26ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.152875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:48.197948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.198605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.198888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.199161 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.199884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.201585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc7f5d-a542-41bd-87c3-ecfb1077c7c4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.211968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1268/2561] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:48.216264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:48.226914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a698-77fe-49a1-99e6-4069e891d2fd admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.231494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.232425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.232712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.232989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] PATH_INFO: `/v3/projects/8d5078bba5f64e3780a18ad03f2018a0/users/8066a40321c347e19f0420fea9b022be/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.235001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5078bba5f64e3780a18ad03f2018a0, user_id=8066a40321c347e19f0420fea9b022be, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.237715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.247889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1294/2562] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:48 2022] PUT /identity/v3/projects/8d5078bba5f64e3780a18ad03f2018a0/users/8066a40321c347e19f0420fea9b022be/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:48.258297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.258750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.258846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.285060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] MFA Rules not processed for user `8066a40321c347e19f0420fea9b022be`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:48.286239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:48.353817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1269/2563] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:37:48.365028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:48.366786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:48.398852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:48.423940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554791-0475-4338-85d5-d5b8df3f7d1e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:48.427706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:48.428714 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:48.428990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:48.429159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:48.485614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:48.487163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:48.496932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1295/2564] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:49.972371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:49.973803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:49.986367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b79922-8df3-4a22-b456-e23dc04ade16 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:49.989871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:49.990499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:49.990780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:49.991056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:50.046095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:50.047535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:50.056513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1270/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:50.569753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:50.578579 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f172-43bf-454d-bbe1-c3cfdb56e747 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:50.582268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:50.582898 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:50.583183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:50.583463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:50.593876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:50.595312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66064a6-01a2-4876-a3cc-ec3c61edd2bd service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:50.606438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1296/2566] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:54.469711 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:54.514779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:54.541664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd4db-800d-446d-949b-a08bbce1094d service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:54.546206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:54.547141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:54.547426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:54.547693 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] PATH_INFO: `/v3/users/3c319e0574aa497abeedbb5b08a70bc1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:54.549073 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c319e0574aa497abeedbb5b08a70bc1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:54.551284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:54.604447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c319e0574aa497abeedbb5b08a70bc1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:54.611835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c319e0574aa497abeedbb5b08a70bc1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:54.612750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c319e0574aa497abeedbb5b08a70bc1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:54.613369 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c319e0574aa497abeedbb5b08a70bc1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:54.622438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c319e0574aa497abeedbb5b08a70bc1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:54.642141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1271/2567] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:54 2022] DELETE /identity/v3/users/3c319e0574aa497abeedbb5b08a70bc1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:54.646736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:54.647303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:54.647303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:54.665625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:54.666949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:54.737791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1297/2568] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:54.749426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:54.751719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:54.825847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd8aa-2942-4a2b-a803-becc2521f82f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:54.830259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:54.830942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:54.831236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:54.831512 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:54.845887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:54.847529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:54.859546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1272/2569] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:55.151600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:55.153235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:55.168662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825ada-9ce8-445f-ad65-7c42a219b748 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:55.175920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:55.177078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:55.177428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:55.177710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] PATH_INFO: `/v3/projects/884479adca2d4f75b227c9dc0a5787a2` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:55.179772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884479adca2d4f75b227c9dc0a5787a2)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:55.181747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:55.235745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884479adca2d4f75b227c9dc0a5787a2', 'request_id': 'req-17204142-c6a2-4fde-9348-7e448358d946'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.241456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884479adca2d4f75b227c9dc0a5787a2', 'request_id': 'req-17204142-c6a2-4fde-9348-7e448358d946'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.249503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884479adca2d4f75b227c9dc0a5787a2', 'request_id': 'req-17204142-c6a2-4fde-9348-7e448358d946'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.250676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:55.263339 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] The token cache is being invalidate because project 884479adca2d4f75b227c9dc0a5787a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:55.263625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.264327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.265940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1298/2570] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:55 2022] DELETE /identity/v3/projects/884479adca2d4f75b227c9dc0a5787a2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:55.269895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:55.280446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648abee-d207-4400-a092-c9e846ff70de service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:55.340462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:55.349288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:55.350912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:55.351676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:55.351975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] PATH_INFO: `/v3/users/2758055aaa224c2687f114fb1cdc955c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:55.353610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2758055aaa224c2687f114fb1cdc955c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:55.355604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:55.405419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2758055aaa224c2687f114fb1cdc955c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.412764 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2758055aaa224c2687f114fb1cdc955c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.413418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2758055aaa224c2687f114fb1cdc955c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.414012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2758055aaa224c2687f114fb1cdc955c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.421327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2758055aaa224c2687f114fb1cdc955c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.438151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1273/2571] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:55 2022] DELETE /identity/v3/users/2758055aaa224c2687f114fb1cdc955c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:55.715936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:55.717394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:55.734280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204142-c6a2-4fde-9348-7e448358d946 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:55.793692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:55.794545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:55.794831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:55.795094 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] PATH_INFO: `/v3/projects/ca78fe40bee04fefbf735f521f983c79` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:55.796342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca78fe40bee04fefbf735f521f983c79)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:55.798248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:55.844599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca78fe40bee04fefbf735f521f983c79', 'request_id': 'req-2221d677-f76b-4ba1-aa3b-b3e08d78022e'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.851413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca78fe40bee04fefbf735f521f983c79', 'request_id': 'req-2221d677-f76b-4ba1-aa3b-b3e08d78022e'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.859606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca78fe40bee04fefbf735f521f983c79', 'request_id': 'req-2221d677-f76b-4ba1-aa3b-b3e08d78022e'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.871069 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] The token cache is being invalidate because project ca78fe40bee04fefbf735f521f983c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:55.871377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.872042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:55.873606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1299/2572] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:55 2022] DELETE /identity/v3/projects/ca78fe40bee04fefbf735f521f983c79 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:37:55.877611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:55.879008 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:55.892264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911ef43-3dd2-4142-8939-2c04f143de53 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:55.954721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:55.955599 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:55.955877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:55.956263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] PATH_INFO: `/v3/users/8066a40321c347e19f0420fea9b022be` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:55.957630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8066a40321c347e19f0420fea9b022be)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:55.960450 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.011251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8066a40321c347e19f0420fea9b022be'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.018365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8066a40321c347e19f0420fea9b022be'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.019391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8066a40321c347e19f0420fea9b022be'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.020011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8066a40321c347e19f0420fea9b022be'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.028258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-835ca35e-737d-4bfc-99dc-b8f96d7582c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8066a40321c347e19f0420fea9b022be'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.042508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:56.051847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1274/2573] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:55 2022] DELETE /identity/v3/users/8066a40321c347e19f0420fea9b022be => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:56.388174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.389689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:56.419026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d677-f76b-4ba1-aa3b-b3e08d78022e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.517497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.518774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.519058 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.519340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] PATH_INFO: `/v3/projects/8d5078bba5f64e3780a18ad03f2018a0` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.520679 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5078bba5f64e3780a18ad03f2018a0)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.523235 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.565771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:56.584849 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5078bba5f64e3780a18ad03f2018a0', 'request_id': 'req-1f86ed2e-5c95-453f-9d3a-ee63901a9955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.590775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5078bba5f64e3780a18ad03f2018a0', 'request_id': 'req-1f86ed2e-5c95-453f-9d3a-ee63901a9955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.599437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5078bba5f64e3780a18ad03f2018a0', 'request_id': 'req-1f86ed2e-5c95-453f-9d3a-ee63901a9955'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.611763 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] The token cache is being invalidate because project 8d5078bba5f64e3780a18ad03f2018a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:37:56.612155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.612878 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1f86ed2e-5c95-453f-9d3a-ee63901a9955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:37:56.614491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1300/2574] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:37:56 2022] DELETE /identity/v3/projects/8d5078bba5f64e3780a18ad03f2018a0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:56.619510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.619837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.620177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.640324 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:56.641546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:56.704860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1275/2575] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:56.714346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.714630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.714905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.733117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:56.734290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:56.743133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1301/2576] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:56.747403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.758387 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5cf3-710d-4c2a-9a38-248769411f59 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.763227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.763905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.764224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.764504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.765229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:37:56.765534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.767147 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.778912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1276/2577] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:37:56.783324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.792485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0085b-eaa1-47b0-9f26-c4381bdbbd27 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.797159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.797790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.798064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.798334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.799035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.800980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.826685 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1302/2578] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:37:56 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:56.830823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.843616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595214-fba9-40ef-9901-b191834335d0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.902316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.903184 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.903394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.903670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.904626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.906873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.926353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1277/2579] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:37:56 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:37:56.930963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.941929 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fb27-e33f-462a-bcf9-30ed16ea14a7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.947319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.947972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.948299 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.948573 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.949303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.950923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.961705 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1303/2580] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:37:56.965410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:56.975358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e62-ed53-403a-8fb3-8d9b1e1afdc4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:56.980248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:56.980891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:56.981173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:56.981447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:56.982166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:56.983817 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30539655-7de0-4259-9316-bdfede73a78d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:56.994252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1278/2581] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:37:56.998338 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:57.008848 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f9dc-1d7d-4a5c-953b-36aad39a0060 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:57.013493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:57.014352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:57.014631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:57.014932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] PATH_INFO: `/v3/projects/fcf6550eda5a4113a164d6b8b4bdd79c/users/f8ddb5ad74ae4c8ab206347d1e5e9750/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:57.035823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf6550eda5a4113a164d6b8b4bdd79c, user_id=f8ddb5ad74ae4c8ab206347d1e5e9750, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:57.039875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:57.054367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1304/2582] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:37:56 2022] PUT /identity/v3/projects/fcf6550eda5a4113a164d6b8b4bdd79c/users/f8ddb5ad74ae4c8ab206347d1e5e9750/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:37:57.064560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:57.064857 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:57.065137 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:57.093678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] MFA Rules not processed for user `f8ddb5ad74ae4c8ab206347d1e5e9750`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:37:57.094893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:57.142497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:37:57.159566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1279/2583] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:37:57.171079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:57.172819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:37:57.229781 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835ce3-7b87-4d18-bcfe-49ae4d974f20 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:57.233396 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:57.234082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:57.234316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:57.234588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:57.243343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:57.244818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716d89-ff90-491a-a2fa-e6f5920a7b2d service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:37:57.253871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1305/2584] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:37:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:37:59.861199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:37:59.958368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5869-a95a-4ff4-9f6d-4a46d7c9a433 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:37:59.963870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:37:59.964870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:37:59.965150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:37:59.965426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] PATH_INFO: `/v3/users/f8ddb5ad74ae4c8ab206347d1e5e9750` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:37:59.966631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ddb5ad74ae4c8ab206347d1e5e9750)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:37:59.968669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.017847 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ddb5ad74ae4c8ab206347d1e5e9750'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.023717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633a0e-8fca-410a-bb37-9f0a20880915 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.024390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633a0e-8fca-410a-bb37-9f0a20880915 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.024711 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44633a0e-8fca-410a-bb37-9f0a20880915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.026410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ddb5ad74ae4c8ab206347d1e5e9750'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.027188 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ddb5ad74ae4c8ab206347d1e5e9750'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.027896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ddb5ad74ae4c8ab206347d1e5e9750'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.039553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ddb5ad74ae4c8ab206347d1e5e9750'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.050866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-44633a0e-8fca-410a-bb37-9f0a20880915 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:00.052168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-44633a0e-8fca-410a-bb37-9f0a20880915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.062766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1306/2585] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:00.066139 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1280/2586] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:37:59 2022] DELETE /identity/v3/users/f8ddb5ad74ae4c8ab206347d1e5e9750 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:00.070551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.070842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.071117 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.084401 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.086209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.094359 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:00.096104 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.176311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:00.204079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1307/2587] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:00.213475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.214888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.216591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ffc1-95de-4682-899a-eba524101953 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:00.228127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:00.229079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.229671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.229954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.237300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:00.245622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:00.249766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.265263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1281/2588] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:00.286014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07593-ff72-42df-b9c5-6685dd184d89 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:00.289795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:00.290434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.290717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.290987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.302521 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:00.304062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef33b6e-0e28-48ab-b4ea-3e30f37c94ca service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.313713 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1308/2589] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:00.610067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.611825 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.626143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda92b-1951-4d5a-8fa9-5a2db902b651 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:00.631713 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:00.632678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.632954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.633220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] PATH_INFO: `/v3/projects/fcf6550eda5a4113a164d6b8b4bdd79c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.634398 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf6550eda5a4113a164d6b8b4bdd79c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:00.637174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.693585 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf6550eda5a4113a164d6b8b4bdd79c', 'request_id': 'req-5d33fe2d-18c2-4f2e-a309-a0283068f263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.701524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf6550eda5a4113a164d6b8b4bdd79c', 'request_id': 'req-5d33fe2d-18c2-4f2e-a309-a0283068f263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.707705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf6550eda5a4113a164d6b8b4bdd79c', 'request_id': 'req-5d33fe2d-18c2-4f2e-a309-a0283068f263'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.721818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] The token cache is being invalidate because project fcf6550eda5a4113a164d6b8b4bdd79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:00.722102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.722754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5d33fe2d-18c2-4f2e-a309-a0283068f263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:00.724325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1282/2590] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:00 2022] DELETE /identity/v3/projects/fcf6550eda5a4113a164d6b8b4bdd79c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:00.731497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.731783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.732140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.752841 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:00.754266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.828004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1309/2591] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:00.835947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.836247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.836681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.859794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:00.861392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:00.870214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1283/2592] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:00.874279 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.883862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5ee72-5b5e-496a-86f8-83eeeef5473d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:00.888379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:00.889013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.889325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.889599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.890308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:00.890629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:00.892462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.903662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1310/2593] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:00.907981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.917729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef345b3-5033-455b-ba81-7c2a5be1765d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:00.922388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:00.923035 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:00.923318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:00.923949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:00.924306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:00.926229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:00.953701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1284/2594] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:00.957612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:00.967419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e32d-9ad2-40c6-ad04-9225a3039328 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:01.025193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:01.025978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.026264 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.026542 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.027234 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:01.029211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:01.051036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1311/2595] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:00 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:01.055944 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:01.066882 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825867f3-b069-498c-85a9-5c641ce2cfc8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:01.071710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:01.072418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.072745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.073022 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.073758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:01.075375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:01.088961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1285/2596] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:01.093193 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:01.109649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c53b-3033-4d95-b115-e371ee80d5a7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:01.118418 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:01.119545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.119996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.120365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.121631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:01.124251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab9e5-b7b5-4dd7-a947-50deb16bbf64 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:01.125873 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:01.136978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1312/2597] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:01.140900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:01.151142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46948ef6-4ae1-4c47-824e-44eb0b53adf4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:01.155796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:01.156695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.156973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.157246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] PATH_INFO: `/v3/projects/176ef65eb3e34bd78f5aee1285122d67/users/03014e54cea04cd9bc4542cc9873ed05/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.172090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176ef65eb3e34bd78f5aee1285122d67, user_id=03014e54cea04cd9bc4542cc9873ed05, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:01.174736 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:01.189016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1286/2598] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:01 2022] PUT /identity/v3/projects/176ef65eb3e34bd78f5aee1285122d67/users/03014e54cea04cd9bc4542cc9873ed05/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:01.200407 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6812-7fde-4652-a73e-38676cf7b13c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.201943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6812-7fde-4652-a73e-38676cf7b13c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.201943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6812-7fde-4652-a73e-38676cf7b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.235313 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-560c6812-7fde-4652-a73e-38676cf7b13c None None] MFA Rules not processed for user `03014e54cea04cd9bc4542cc9873ed05`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:01.236544 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-560c6812-7fde-4652-a73e-38676cf7b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:01.300041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1313/2599] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:01.311028 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:01.312823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:01.369313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055775-89dd-4a77-96df-10fcd8daced6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:01.372984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:01.373614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:01.373892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:01.374167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:01.382885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:01.384355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:01.393114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1287/2600] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:06.439165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588336-7909-469a-be38-b88d12554c8b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:06.439765 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588336-7909-469a-be38-b88d12554c8b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:06.439962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb588336-7909-469a-be38-b88d12554c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:06.459423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-bb588336-7909-469a-be38-b88d12554c8b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:06.461038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-bb588336-7909-469a-be38-b88d12554c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:06.531566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1314/2601] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:06.552275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:06.553864 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:06.580056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:06.644732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dea050-3a09-4684-af38-f486d2309ac8 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:06.651258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:06.651768 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:06.652092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:06.652416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:06.662228 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:06.663773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:06.675269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1288/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:09.471413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:09.471860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:09.471972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:09.490756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:09.491978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:09.499874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1315/2603] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:09.526062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:09.527562 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:09.542191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3de0-9686-4d3a-9aeb-89427e382d77 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:09.547766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:09.548511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:09.548788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:09.549058 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:09.558477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:09.560080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:09.570448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1289/2604] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:12.638565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:12.640331 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:12.697348 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904530e1-b78a-46c4-8a2f-bbf753dbe3a0 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:12.701048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:12.701683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:12.701966 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:12.702240 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:12.704000 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:12.715654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:12.717124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab382ed-bc74-454d-bd57-07cb6c770d8c service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:12.727064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1316/2605] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:15.745720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:15.747180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:15.762826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce50a9-be9d-4802-ad1a-c628fa3bd21d service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:15.768752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:15.769630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:15.769929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:15.770200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] PATH_INFO: `/v3/users/d39a17af7fa84627b4d3e6543000ef27` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:15.772066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39a17af7fa84627b4d3e6543000ef27)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:15.773381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:15.782625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:15.783175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:15.783262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:15.809601 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:15.810984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:15.821107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1317/2606] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:15.828838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39a17af7fa84627b4d3e6543000ef27'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:15.835815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39a17af7fa84627b4d3e6543000ef27'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:15.836556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39a17af7fa84627b4d3e6543000ef27'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:15.837498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39a17af7fa84627b4d3e6543000ef27'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:15.847913 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39a17af7fa84627b4d3e6543000ef27'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:15.849677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:15.863217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0a651-34b2-4df0-be4b-2bec2c15c352 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:15.867762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1290/2607] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:15 2022] DELETE /identity/v3/users/d39a17af7fa84627b4d3e6543000ef27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:15.873422 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:15.874076 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:15.874368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:15.874646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:15.876518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:15.889438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:15.891051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9c3b0-1203-47ce-b385-3024507adda9 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:15.901794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1318/2608] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:16.058279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.059770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:16.135835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50023-9d0f-4ec1-aabc-fe0d9a04fc90 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.140361 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.141216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.141493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.141766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] PATH_INFO: `/v3/projects/2d5600e2a31d4bffa9a2d5b87f605bcd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.142947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5600e2a31d4bffa9a2d5b87f605bcd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.144908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.147565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:16.202915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5600e2a31d4bffa9a2d5b87f605bcd', 'request_id': 'req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:16.215025 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5600e2a31d4bffa9a2d5b87f605bcd', 'request_id': 'req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:16.221447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5600e2a31d4bffa9a2d5b87f605bcd', 'request_id': 'req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:16.235276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] The token cache is being invalidate because project 2d5600e2a31d4bffa9a2d5b87f605bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:16.235605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:16.236357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a81a9f8f-a651-4d5e-bc1e-a2e348b29450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:16.238460 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1291/2609] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:16 2022] DELETE /identity/v3/projects/2d5600e2a31d4bffa9a2d5b87f605bcd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:16.243056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.243345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.243656 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.250261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:16.263492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:16.264887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:16.329005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1319/2610] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:16.337263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.337552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.337836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.357141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:16.358365 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:16.366340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1292/2611] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:16.370554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.380471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bf469-8dbb-45cf-9cdc-41983b51194c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.385428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.386075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.386356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.386630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.387341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:16.387643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.389514 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.402351 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1320/2612] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:16.406844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.417345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe307e-01f9-4954-b50f-e87c2febed2e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.422024 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.422673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.422962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.423253 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.423965 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.425928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.455222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1293/2613] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:16.456421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.466767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3bb99-6a8b-4541-993b-1132bf81ff46 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.529861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.530525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.530807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.531083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.531766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.533918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.558416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1321/2614] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:16.559621 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.572854 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3819-72cd-460e-9ad1-ab94d710c9e3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.577759 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.578454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.578867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.579152 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.579904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.581544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.593807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1294/2615] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:16.598281 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.611770 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ae916-f6ee-4026-8421-25f87c44c3d5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.616637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.617301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.617639 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.617922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.618657 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.620566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad24611-a0e0-45fd-9ad4-98af9121845c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.639716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1322/2616] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:16.643810 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.654663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8ff66-2a4e-4771-b2d2-da922dc40717 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.659287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.660266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.660551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.660846 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] PATH_INFO: `/v3/projects/57cf86e413484caa947307877154540c/users/6dccd36e1ce248b1b848e2ab6dea6ac6/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.676699 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cf86e413484caa947307877154540c, user_id=6dccd36e1ce248b1b848e2ab6dea6ac6, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.679723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.694639 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1295/2617] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:16 2022] PUT /identity/v3/projects/57cf86e413484caa947307877154540c/users/6dccd36e1ce248b1b848e2ab6dea6ac6/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:16.705288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.705582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.705920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.736974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] MFA Rules not processed for user `6dccd36e1ce248b1b848e2ab6dea6ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:16.738280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:16.809879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:16.816581 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1323/2618] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:16.821179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.893440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c60e0-e2ee-4d99-8e90-596754758738 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:16.907452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:16.907452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:16.907452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:16.907452 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:16.907886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:16.907886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:16.931444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1296/2619] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:16.935596 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:16.946508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba1662-ae4f-48de-b831-34bac306455f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.005361 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.006027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.006311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.006586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.007317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.009237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.029869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1324/2620] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:16 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:17.033742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.044179 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737f303-17a7-4b0e-89e8-e7dd1696ff1c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.048973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.049636 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.049923 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.050199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.050926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.053172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.064084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1297/2621] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:17.069336 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.080885 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dce21-9e8f-46e9-a441-de22d86b53c4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.085902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.086833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.087116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.087390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] PATH_INFO: `/v3/projects/92c675b987fc44e881c3bae09f72b78f/users/5ca183910b504db7a5bc313ec36e6d98/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.102646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c675b987fc44e881c3bae09f72b78f, user_id=5ca183910b504db7a5bc313ec36e6d98, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.105585 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.119545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1325/2622] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:17 2022] PUT /identity/v3/projects/92c675b987fc44e881c3bae09f72b78f/users/5ca183910b504db7a5bc313ec36e6d98/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:17.123686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.128906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:17.135875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720257b-af09-4b14-94b2-497ea82222d1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.193404 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.194065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.194343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.194622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.195342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.196978 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d89e-8cda-401b-a62c-c96adfad7885 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.207949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1298/2623] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:17.211524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.222210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56f11-3e05-44b9-9e9a-9f96e62146f7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.227288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.228189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.228472 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.228768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] PATH_INFO: `/v3/projects/92c675b987fc44e881c3bae09f72b78f/users/5ca183910b504db7a5bc313ec36e6d98/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.230963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c675b987fc44e881c3bae09f72b78f, user_id=5ca183910b504db7a5bc313ec36e6d98, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.233750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.245176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1326/2624] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:17 2022] PUT /identity/v3/projects/92c675b987fc44e881c3bae09f72b78f/users/5ca183910b504db7a5bc313ec36e6d98/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:17.256770 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.257043 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.257371 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.285038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] MFA Rules not processed for user `5ca183910b504db7a5bc313ec36e6d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:17.286281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:17.359956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1299/2625] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:17.371887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.373619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:17.434617 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f438cb4-c79b-4b9c-9625-560f7f9aa512 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.438255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.438890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.439168 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.439439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.449914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.451358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3232fe-b89c-4cc2-a49e-9d004cf0c5b8 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:17.460817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1327/2626] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:17.885414 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:17.963638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba8b1-1861-4e90-a358-56c21200a68d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:17.968242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:17.969103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:17.969378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:17.969715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] PATH_INFO: `/v3/users/6dccd36e1ce248b1b848e2ab6dea6ac6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:17.970828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dccd36e1ce248b1b848e2ab6dea6ac6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:17.972820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:18.004386 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:18.027760 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dccd36e1ce248b1b848e2ab6dea6ac6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.034824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dccd36e1ce248b1b848e2ab6dea6ac6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.035513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dccd36e1ce248b1b848e2ab6dea6ac6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.036172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dccd36e1ce248b1b848e2ab6dea6ac6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.047718 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dccd36e1ce248b1b848e2ab6dea6ac6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.070871 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1300/2627] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:17 2022] DELETE /identity/v3/users/6dccd36e1ce248b1b848e2ab6dea6ac6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:18.075307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:18.075773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:18.076046 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:18.102153 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:18.103340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:18.151224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:18.165352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1328/2628] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:18.174989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:18.176421 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:18.236335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb84e-33f5-42a3-b558-c56f14923dec admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:18.240547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:18.241218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:18.241505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:18.241780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:18.250794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:18.252265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:18.262150 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1301/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:18.543453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:18.545259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:18.558380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f041-f6b7-4f48-8cea-0a840782958a None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:18.563824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:18.564726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:18.565111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:18.565276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] PATH_INFO: `/v3/projects/57cf86e413484caa947307877154540c` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:18.567171 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cf86e413484caa947307877154540c)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:18.569855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:18.622910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cf86e413484caa947307877154540c', 'request_id': 'req-e4d93e96-cf01-4e08-95d0-404b9382b328'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.628393 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cf86e413484caa947307877154540c', 'request_id': 'req-e4d93e96-cf01-4e08-95d0-404b9382b328'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.637421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cf86e413484caa947307877154540c', 'request_id': 'req-e4d93e96-cf01-4e08-95d0-404b9382b328'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.651760 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] The token cache is being invalidate because project 57cf86e413484caa947307877154540c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:18.652045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.652696 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.654229 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1329/2630] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:18 2022] DELETE /identity/v3/projects/57cf86e413484caa947307877154540c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:18.658175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:18.667604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980c238-3811-4b7b-8440-a72c38dee24d service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:18.734117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:18.735071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:18.738262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:18.738572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] PATH_INFO: `/v3/users/5ca183910b504db7a5bc313ec36e6d98` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:18.740543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca183910b504db7a5bc313ec36e6d98)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:18.742504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:18.802036 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca183910b504db7a5bc313ec36e6d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.803265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:18.812938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca183910b504db7a5bc313ec36e6d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.814877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca183910b504db7a5bc313ec36e6d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.814877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca183910b504db7a5bc313ec36e6d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.823471 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a289e443-652a-4f5a-9414-1104b467f880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca183910b504db7a5bc313ec36e6d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:18.854860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1302/2631] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:18 2022] DELETE /identity/v3/users/5ca183910b504db7a5bc313ec36e6d98 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:19.157162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.158676 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:19.171963 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d93e96-cf01-4e08-95d0-404b9382b328 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.294090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.295492 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.296244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.296548 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] PATH_INFO: `/v3/projects/92c675b987fc44e881c3bae09f72b78f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.297871 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c675b987fc44e881c3bae09f72b78f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.300047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.357800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c675b987fc44e881c3bae09f72b78f', 'request_id': 'req-982013ca-659d-4348-8231-25b8b3213bdf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:19.364775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c675b987fc44e881c3bae09f72b78f', 'request_id': 'req-982013ca-659d-4348-8231-25b8b3213bdf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:19.375060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c675b987fc44e881c3bae09f72b78f', 'request_id': 'req-982013ca-659d-4348-8231-25b8b3213bdf'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:19.387558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] The token cache is being invalidate because project 92c675b987fc44e881c3bae09f72b78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:19.387850 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:19.388532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-982013ca-659d-4348-8231-25b8b3213bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:19.390107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1330/2632] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:19 2022] DELETE /identity/v3/projects/92c675b987fc44e881c3bae09f72b78f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:19.395376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.395938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.396059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.413933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:19.415239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:19.484668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1303/2633] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:19.492800 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.493078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.493358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.506380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:19.513316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:19.516078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:19.527293 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1331/2634] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:19.531663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.542570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e6767-9f5b-4310-8dc6-46f26c1d86d1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.547601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.548423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.548767 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.549107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.550048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:19.550419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.554522 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.568090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1304/2635] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:19.571964 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.585304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507143-b257-4dc4-ae22-c93e5dfde55f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.590913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.591582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.591865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.592184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.592883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.594965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.631554 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1332/2636] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:19.635490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.647668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeec1f-8506-4a11-97bd-ee974bee54cc admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.743997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.745063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.745384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.745809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.746596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.748611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.797729 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1305/2637] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:19 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:19.801832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.823732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1465c-71a1-4d39-84bc-0e9f085dc972 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.828900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.829661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.830020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.830369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.831317 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.843463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.871310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.881075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1333/2638] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:19.883221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844cbd-e25c-4f1c-aabb-195336ad6008 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.892451 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.893347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.893775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.894229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.896427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.898313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994a7e1-75c6-40cd-a1e9-90c3bfe085c4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.912631 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1306/2639] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:19.916497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:19.931831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de11e1-e8da-4aa3-868d-5f1efdc4186f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:19.936884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:19.938013 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.938169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.938611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] PATH_INFO: `/v3/projects/43aa4ec817904bbe921316edcb9dd598/users/c8d64c5de60d44d6ac658d264468f088/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:19.956330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43aa4ec817904bbe921316edcb9dd598, user_id=c8d64c5de60d44d6ac658d264468f088, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:19.961534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:19.978208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1334/2640] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:19 2022] PUT /identity/v3/projects/43aa4ec817904bbe921316edcb9dd598/users/c8d64c5de60d44d6ac658d264468f088/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:19.988790 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:19.989591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:19.989874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.019832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] MFA Rules not processed for user `c8d64c5de60d44d6ac658d264468f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:20.021160 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:20.040304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:20.098009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1307/2641] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:20.099216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.167437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8cb3-f6f5-4aa3-8701-b48ea6e62542 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.172325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.172984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.173266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.173547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.174241 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.176192 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.208308 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1335/2642] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:20 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:20.211483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.223710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef5aa-786b-4269-bdc3-22f5802b1e40 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.297171 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.297956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.298318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.298632 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.299554 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.302155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.324344 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1308/2643] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:20 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:20.328483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.340265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f11de-0e17-4ad0-a0ec-2306ed261496 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.345095 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.345761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.346044 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.346320 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.348198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.349488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.371330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1336/2644] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:20.375339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.389418 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d912c-603c-4957-a921-d22d9220a109 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.396360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.397502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.397891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.398237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] PATH_INFO: `/v3/projects/196dd58bd4c44aa89638a1bc9018fcee/users/2f1a6b87f5794cc7a1334d320c85419a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.421872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196dd58bd4c44aa89638a1bc9018fcee, user_id=2f1a6b87f5794cc7a1334d320c85419a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.425558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.441942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1309/2645] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:20 2022] PUT /identity/v3/projects/196dd58bd4c44aa89638a1bc9018fcee/users/2f1a6b87f5794cc7a1334d320c85419a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:20.446266 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.459509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b5ff-74e1-4842-8b99-2091e564aaf8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.525515 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.526408 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.526750 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.527093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.527893 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.529629 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4324bd-7bce-4fc9-9615-492e5eb038e6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.540566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1337/2646] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:20.544698 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.556315 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d1de-4ec9-435a-bf7c-c6770344bf44 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.561725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.562622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.562897 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.563166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] PATH_INFO: `/v3/projects/196dd58bd4c44aa89638a1bc9018fcee/users/2f1a6b87f5794cc7a1334d320c85419a/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.565248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196dd58bd4c44aa89638a1bc9018fcee, user_id=2f1a6b87f5794cc7a1334d320c85419a, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.568730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.580626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1310/2647] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:20 2022] PUT /identity/v3/projects/196dd58bd4c44aa89638a1bc9018fcee/users/2f1a6b87f5794cc7a1334d320c85419a/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:20.593969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.594254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.594533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.622913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:20.624851 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] MFA Rules not processed for user `2f1a6b87f5794cc7a1334d320c85419a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:20.626498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:20.705787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1338/2648] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:20.718356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.720084 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:20.777701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63823-d3cd-433e-84ad-f0c1d59b26c3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.781635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.782355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.782640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.782915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.793102 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.794542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22f73a-a976-4fec-871f-4146ebd53bac service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.803909 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1311/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:20.831943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:20.902441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c1c8-1626-48ff-bc11-9798416f2c32 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:20.907788 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:20.909096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:20.909467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:20.909842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] PATH_INFO: `/v3/users/c8d64c5de60d44d6ac658d264468f088` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:20.911989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d64c5de60d44d6ac658d264468f088)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:20.914038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:20.967667 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d64c5de60d44d6ac658d264468f088'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:20.968352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d64c5de60d44d6ac658d264468f088'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:20.979811 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d64c5de60d44d6ac658d264468f088'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:20.987480 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d64c5de60d44d6ac658d264468f088'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:20.988123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-410a0c30-562f-4ecf-a37e-9421df18db58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d64c5de60d44d6ac658d264468f088'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.003508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36798-49af-485f-9c60-97caada53aed None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.003802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36798-49af-485f-9c60-97caada53aed None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.004120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36798-49af-485f-9c60-97caada53aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.005377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1339/2650] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:20 2022] DELETE /identity/v3/users/c8d64c5de60d44d6ac658d264468f088 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:21.009509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.009796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.010124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.027607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:21.028261 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9cb36798-49af-485f-9c60-97caada53aed None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:21.028876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:21.029459 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9cb36798-49af-485f-9c60-97caada53aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:21.040065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:21.041478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:21.099026 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1340/2651] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:21.104518 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1312/2652] 10.222.0.59 () {58 vars in 1016 bytes} [Fri Jun 24 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:21.105691 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:21.107129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:21.125853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb36798-49af-485f-9c60-97caada53aed None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:21.127593 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9cb36798-49af-485f-9c60-97caada53aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:21.164856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253405df-3892-4caf-9222-ba7bbd0fc239 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:21.169645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:21.170295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.172087 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.172378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.182347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:21.183796 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:21.193720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1341/2653] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:21.209331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb36798-49af-485f-9c60-97caada53aed None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:21.214916 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:21.215641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.215924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.216227 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.227283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:21.230209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:21.241741 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1313/2654] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:21.476347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:21.477959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:21.493385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf076c0-5cea-4c54-b439-a162e590bcc0 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:21.499124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:21.500214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.500495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.500767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] PATH_INFO: `/v3/projects/43aa4ec817904bbe921316edcb9dd598` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.502020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43aa4ec817904bbe921316edcb9dd598)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:21.503952 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:21.563583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43aa4ec817904bbe921316edcb9dd598', 'request_id': 'req-354f8558-37c7-4a8d-9ea9-41869d04259b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.575734 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43aa4ec817904bbe921316edcb9dd598', 'request_id': 'req-354f8558-37c7-4a8d-9ea9-41869d04259b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.583591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43aa4ec817904bbe921316edcb9dd598', 'request_id': 'req-354f8558-37c7-4a8d-9ea9-41869d04259b'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.594909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] The token cache is being invalidate because project 43aa4ec817904bbe921316edcb9dd598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:21.595196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.595951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.597622 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1342/2655] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:21 2022] DELETE /identity/v3/projects/43aa4ec817904bbe921316edcb9dd598 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:21.602738 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:21.612844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519650-fe0c-43ec-bca2-94a33e3b83bb service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:21.673057 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:21.673845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:21.674125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:21.674400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] PATH_INFO: `/v3/users/2f1a6b87f5794cc7a1334d320c85419a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:21.675591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1a6b87f5794cc7a1334d320c85419a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:21.678159 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:21.734890 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:21.741652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1a6b87f5794cc7a1334d320c85419a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.756080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1a6b87f5794cc7a1334d320c85419a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.756836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1a6b87f5794cc7a1334d320c85419a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.757474 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1a6b87f5794cc7a1334d320c85419a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.767696 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-72ed70fd-ad86-4495-8a42-73941508d9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1a6b87f5794cc7a1334d320c85419a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:21.788064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1314/2656] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:21 2022] DELETE /identity/v3/users/2f1a6b87f5794cc7a1334d320c85419a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:22.092494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.094185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:22.130768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8558-37c7-4a8d-9ea9-41869d04259b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.185917 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:22.203541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.204471 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.204757 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.205038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] PATH_INFO: `/v3/projects/196dd58bd4c44aa89638a1bc9018fcee` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.206233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196dd58bd4c44aa89638a1bc9018fcee)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.208749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.268786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196dd58bd4c44aa89638a1bc9018fcee', 'request_id': 'req-1c34ae74-4872-4af8-8f83-58538d31b748'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:22.275883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196dd58bd4c44aa89638a1bc9018fcee', 'request_id': 'req-1c34ae74-4872-4af8-8f83-58538d31b748'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:22.283916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196dd58bd4c44aa89638a1bc9018fcee', 'request_id': 'req-1c34ae74-4872-4af8-8f83-58538d31b748'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:22.300265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] The token cache is being invalidate because project 196dd58bd4c44aa89638a1bc9018fcee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:22.300558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:22.301223 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-1c34ae74-4872-4af8-8f83-58538d31b748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:22.302831 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1343/2657] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:22 2022] DELETE /identity/v3/projects/196dd58bd4c44aa89638a1bc9018fcee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:22.307765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.308151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.308436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.326435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:22.327752 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:22.391326 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1315/2658] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:22.400118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.400118 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.400414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.419126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:22.420368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:22.428957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1344/2659] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:22.433346 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.443071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fa8e-1f79-42e3-b72a-bf345e650c5e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.447656 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.448331 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.448612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.448887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.449606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:22.449908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.451520 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.463672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1316/2660] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:22.467772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.481427 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beacc5e-6494-459e-baec-8692eb95eb58 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.486603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.487262 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.487539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.487809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.488631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.492208 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.518190 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1345/2661] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:22.522796 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.533220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010bc3-9a4b-435e-931b-3ad07d6104de admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.599017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.599678 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.600052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.600268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.601210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.603140 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.625855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1317/2662] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:22.630006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.640142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c593ce6-4824-4167-8def-2c15b4238df8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.644756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.645364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.645741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.646015 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.646740 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.648457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.660551 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1346/2663] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:22.665089 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.678962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e2bf-1998-4074-b7d1-137c6e1780b8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.683992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.684689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.684968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.685237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.685959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.687548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597edd0-4e7b-4f7e-b639-7419df547074 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.697855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1318/2664] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:22.702010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.711926 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e167-b606-425f-9a26-2d6c8f36e4c0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.716678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.717495 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.717774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.718050 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] PATH_INFO: `/v3/projects/86e3a9d6506d47b790a7d469a57ce39d/users/f13755e5b57647b3a5e09fa7d3b8f60f/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.733433 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e3a9d6506d47b790a7d469a57ce39d, user_id=f13755e5b57647b3a5e09fa7d3b8f60f, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.736132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.751298 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1347/2665] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:22 2022] PUT /identity/v3/projects/86e3a9d6506d47b790a7d469a57ce39d/users/f13755e5b57647b3a5e09fa7d3b8f60f/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:22.761529 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.761815 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.762086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.792384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] MFA Rules not processed for user `f13755e5b57647b3a5e09fa7d3b8f60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:22.793575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:22.809697 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:22.868889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1319/2666] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:22.873439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.934951 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f51c0-ef80-4abe-a648-8eb7b4a883c6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:22.939728 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:22.940430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:22.940710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:22.940983 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:22.941814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:22.943941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:22.960258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:22.984216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1348/2667] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:22.985526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:22.996583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e0bc5-ca02-4db4-ba7d-dab10438423d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.056320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.056990 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.057271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.057561 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.058247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.060191 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.082222 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1320/2668] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:22 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:23.085947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:23.096888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787df7-0820-4b4a-a45e-fe1f49088153 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.103511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.104312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.104652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.104934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.105675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.107350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.118766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1349/2669] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:23.122959 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:23.135717 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a682-17dc-4852-8f7f-1b70e6564bcf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.142822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.143721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.144000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.144308 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] PATH_INFO: `/v3/projects/cb9e74dded324aa6a288dc19a6e4850d/users/c9e70bf52b3946108d4a30b897c4503f/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.161688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9e74dded324aa6a288dc19a6e4850d, user_id=c9e70bf52b3946108d4a30b897c4503f, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.164560 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.178464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1321/2670] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:23 2022] PUT /identity/v3/projects/cb9e74dded324aa6a288dc19a6e4850d/users/c9e70bf52b3946108d4a30b897c4503f/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:23.182355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:23.192220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17ac2-5a82-4c86-9c25-16eb053a7b6c admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.248992 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.249653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.249931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.250205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.250923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.252560 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102fbb3-b0a8-4767-8868-290e36d03797 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.262337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1350/2671] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:23.266564 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:23.277572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f390-9744-43e9-bfe9-fc99146221ea admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.282138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.283003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.283283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.283557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] PATH_INFO: `/v3/projects/cb9e74dded324aa6a288dc19a6e4850d/users/c9e70bf52b3946108d4a30b897c4503f/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.285551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9e74dded324aa6a288dc19a6e4850d, user_id=c9e70bf52b3946108d4a30b897c4503f, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.289056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.300138 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1322/2672] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:23 2022] PUT /identity/v3/projects/cb9e74dded324aa6a288dc19a6e4850d/users/c9e70bf52b3946108d4a30b897c4503f/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:23.311189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.311485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.311767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.340132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] MFA Rules not processed for user `c9e70bf52b3946108d4a30b897c4503f`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:23.341391 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:23.419244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1351/2673] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:23.436513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:23.437609 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:23.520291 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be1c-db98-4b46-af5b-f7e377c3b8a6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:23.523948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:23.524676 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:23.524957 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:23.525232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:23.536461 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:23.538126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf8a67-caf6-4d0d-8c4b-1af3541bb154 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:23.553800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1323/2674] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:24.142980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:24.209107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496990bf-3391-41e7-b3b4-450e5fb84f7b None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:24.213786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:24.214659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:24.214941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:24.215218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] PATH_INFO: `/v3/users/f13755e5b57647b3a5e09fa7d3b8f60f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:24.216459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13755e5b57647b3a5e09fa7d3b8f60f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:24.218395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:24.227940 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:24.270200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13755e5b57647b3a5e09fa7d3b8f60f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.270787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13755e5b57647b3a5e09fa7d3b8f60f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.277716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13755e5b57647b3a5e09fa7d3b8f60f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.285646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13755e5b57647b3a5e09fa7d3b8f60f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.286916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13755e5b57647b3a5e09fa7d3b8f60f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.305282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1352/2675] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:24 2022] DELETE /identity/v3/users/f13755e5b57647b3a5e09fa7d3b8f60f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:24.309861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:24.310373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:24.310481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:24.327956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:24.329193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:24.334124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:24.389881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1324/2676] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:24.399370 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:24.400902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:24.460678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8952e0c-2e76-4d81-8fae-1c24c28ad29a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:24.464385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:24.465028 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:24.465312 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:24.465587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:24.475780 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:24.477623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:24.487769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1353/2677] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:24.660625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:24.671528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f4b9b-debd-4c88-8fa4-878c2f635d5f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:24.675270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:24.677092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:24.677092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:24.677092 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:24.678674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:24.692544 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:24.694953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:24.705389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1325/2678] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:24.898151 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:24.899595 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:24.912543 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc939e0-0e71-4acc-a3fd-429ffc5ab26d service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:24.922839 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:24.923812 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:24.924158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:24.924506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] PATH_INFO: `/v3/projects/86e3a9d6506d47b790a7d469a57ce39d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:24.925794 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e3a9d6506d47b790a7d469a57ce39d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:24.928194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:24.978572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e3a9d6506d47b790a7d469a57ce39d', 'request_id': 'req-0bcd826b-f34a-44b0-b434-e61a3037e774'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.984814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e3a9d6506d47b790a7d469a57ce39d', 'request_id': 'req-0bcd826b-f34a-44b0-b434-e61a3037e774'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:24.992987 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e3a9d6506d47b790a7d469a57ce39d', 'request_id': 'req-0bcd826b-f34a-44b0-b434-e61a3037e774'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.004202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] The token cache is being invalidate because project 86e3a9d6506d47b790a7d469a57ce39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:25.004988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.005715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.007242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1354/2679] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:24 2022] DELETE /identity/v3/projects/86e3a9d6506d47b790a7d469a57ce39d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:25.011216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:25.021622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3794a1-9ce6-4500-9467-27c8461f00ef service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:25.090435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:25.091381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.091726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.095444 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] PATH_INFO: `/v3/users/c9e70bf52b3946108d4a30b897c4503f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.097265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e70bf52b3946108d4a30b897c4503f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:25.099830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:25.153349 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e70bf52b3946108d4a30b897c4503f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.160493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e70bf52b3946108d4a30b897c4503f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.161250 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e70bf52b3946108d4a30b897c4503f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.161895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e70bf52b3946108d4a30b897c4503f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.171802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-49785cee-98eb-4ce0-a79d-560f3f5d752a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e70bf52b3946108d4a30b897c4503f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.197001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1326/2680] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:25 2022] DELETE /identity/v3/users/c9e70bf52b3946108d4a30b897c4503f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:25.514126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:25.515721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:25.530406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd826b-f34a-44b0-b434-e61a3037e774 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:25.542912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:25.594880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:25.595743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.596054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.596329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] PATH_INFO: `/v3/projects/cb9e74dded324aa6a288dc19a6e4850d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.597519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9e74dded324aa6a288dc19a6e4850d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:25.599970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:25.648255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9e74dded324aa6a288dc19a6e4850d', 'request_id': 'req-d6680d2b-6276-422c-a452-d179147f7cf7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.654163 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9e74dded324aa6a288dc19a6e4850d', 'request_id': 'req-d6680d2b-6276-422c-a452-d179147f7cf7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.662665 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9e74dded324aa6a288dc19a6e4850d', 'request_id': 'req-d6680d2b-6276-422c-a452-d179147f7cf7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.674041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] The token cache is being invalidate because project cb9e74dded324aa6a288dc19a6e4850d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:25.674321 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.674970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6680d2b-6276-422c-a452-d179147f7cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:25.677071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1355/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:25 2022] DELETE /identity/v3/projects/cb9e74dded324aa6a288dc19a6e4850d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:25.682877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.683416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.683534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.702849 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:25.704126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:25.719602 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:25.771303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1327/2682] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:25.779435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.779791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.780170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.800165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:25.801520 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:25.815403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1356/2683] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:25.820801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:25.830753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4036a-934c-4cef-acb9-0e7144ff149b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:25.835633 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:25.836318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.836601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.836874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.837597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:25.838325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:25.839580 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:25.852480 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1328/2684] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:25.856902 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:25.867311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff2e26-fc77-4821-8a3a-561329de4c39 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:25.874060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:25.874716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.874996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.875270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.875971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:25.877999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:25.909133 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1357/2685] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:25 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:25.910309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:25.921181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e53e-0e87-4446-a444-3493276b143c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:25.986826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:25.987442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:25.987722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:25.987996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:25.989014 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:25.990985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.018448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1329/2686] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:25 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:26.019756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.032862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1131ee-406f-4247-b393-82112d5e81ad admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.038771 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.039550 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.039974 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.040343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.041079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.042700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.054688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1358/2687] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:26.058889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.069715 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49ed8-7142-4963-8872-b147f734190f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.076054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.076572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.076851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.077281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.078021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.080009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02b2c-1d07-403a-91c2-10616494623c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.092080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1330/2688] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:26.096888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.110212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006033e-0464-4c52-bf20-50721642c82e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.116597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.117557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.117982 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.118500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] PATH_INFO: `/v3/projects/4d22e1343efb4ff6b31aba3a5075a758/users/014f8ea05c9844ae84eb8197c06ff8b4/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.150533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d22e1343efb4ff6b31aba3a5075a758, user_id=014f8ea05c9844ae84eb8197c06ff8b4, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.153989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.179441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1359/2689] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:26 2022] PUT /identity/v3/projects/4d22e1343efb4ff6b31aba3a5075a758/users/014f8ea05c9844ae84eb8197c06ff8b4/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:26.191509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.191804 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.192165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.236389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] MFA Rules not processed for user `014f8ea05c9844ae84eb8197c06ff8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:26.238734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:26.319435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1331/2690] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:26.323531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.364739 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:26.395755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae38c-ebf0-4b77-9d65-30590f3a69f0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.404011 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.405428 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.405726 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.406005 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.407183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.412455 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.455552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1360/2691] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:26 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:26.460175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.471677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592e0dd-5864-4b89-b692-c3e63df4e56b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.482413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:26.548788 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.549502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.549787 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.550053 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.550753 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.552779 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.578566 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1332/2692] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:26 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:26.580086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.593130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18831e0-dd1d-43ad-a1ef-fba8a70e7598 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.598939 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.600074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.600074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.600342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.601187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.602891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.615397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1361/2693] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:26.619592 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.631090 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fa3de-a691-4072-92b5-7a2630a14d8a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.636203 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.637189 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.637667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.638042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] PATH_INFO: `/v3/projects/2ea5f3fb78634e92968a360820f8937a/users/39a892dcc6774704a735377e848e2244/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.657298 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea5f3fb78634e92968a360820f8937a, user_id=39a892dcc6774704a735377e848e2244, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.661119 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.679893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1333/2694] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:26 2022] PUT /identity/v3/projects/2ea5f3fb78634e92968a360820f8937a/users/39a892dcc6774704a735377e848e2244/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:26.681196 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.691869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4007b-fe94-4fa0-bd7b-29dec9146df0 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.764399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.765083 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.765366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.765644 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.766382 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.768224 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932d386-e3c9-4784-9579-51751a580ddd admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.780532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1362/2695] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:26.784789 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.797270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132f88-012a-4e2d-a412-4aa5e09f8e50 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:26.805672 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:26.806845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.807300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.807774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] PATH_INFO: `/v3/projects/2ea5f3fb78634e92968a360820f8937a/users/39a892dcc6774704a735377e848e2244/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.810056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea5f3fb78634e92968a360820f8937a, user_id=39a892dcc6774704a735377e848e2244, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:26.813573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:26.826117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1334/2696] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:26 2022] PUT /identity/v3/projects/2ea5f3fb78634e92968a360820f8937a/users/39a892dcc6774704a735377e848e2244/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:26.837903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:26.838325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:26.838456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:26.868900 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] MFA Rules not processed for user `39a892dcc6774704a735377e848e2244`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:26.870122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:26.947289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1363/2697] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:26.959009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:26.961059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:27.029885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2843-6206-4363-af27-b93405dfd6a9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:27.034428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:27.035310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.035926 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.036388 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.047708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:27.049703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:27.061860 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1335/2698] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:27.140506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:27.151218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be5ed0-521a-4eca-8574-6f65cae42992 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:27.154863 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:27.155518 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.155821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.156139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.197712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:27.246958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:27.248503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:27.258147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1364/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:27.551524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:27.635473 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88d97-ebaa-47aa-9fa7-48959d779fd3 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:27.640640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:27.641553 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.641837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.642258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] PATH_INFO: `/v3/users/014f8ea05c9844ae84eb8197c06ff8b4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.643551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014f8ea05c9844ae84eb8197c06ff8b4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:27.646295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:27.665644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:27.707211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:27.709399 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:27.712124 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014f8ea05c9844ae84eb8197c06ff8b4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:27.719483 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014f8ea05c9844ae84eb8197c06ff8b4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:27.720209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014f8ea05c9844ae84eb8197c06ff8b4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:27.720853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014f8ea05c9844ae84eb8197c06ff8b4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:27.730756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f6f41cf6-7889-4a22-9f1c-4eec7f7f53e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014f8ea05c9844ae84eb8197c06ff8b4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:27.752523 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1336/2700] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:27 2022] DELETE /identity/v3/users/014f8ea05c9844ae84eb8197c06ff8b4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:27.754155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.754475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.754754 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.772735 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:27.773924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:27.779522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115234df-4b6f-4432-9bcb-1d1b65b4f48c service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:27.835137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:27.835888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.836216 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.836488 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.838767 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:27.848104 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1337/2701] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:27.858174 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:27.859641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:27.872077 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbb26e-17fa-40f4-9a4e-7b0487384343 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:27.878363 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:27.879961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:27.880367 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:27.880891 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:27.892248 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:27.893889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:27.905739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1338/2702] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:27.928991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:27.930527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:27.951978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1365/2703] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:28.326731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:28.328615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:28.350843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fab820-70b6-4e5b-921d-df59e3b2f421 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:28.366546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:28.367176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:28.367455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:28.367730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] PATH_INFO: `/v3/projects/4d22e1343efb4ff6b31aba3a5075a758` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:28.369606 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d22e1343efb4ff6b31aba3a5075a758)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:28.371501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:28.465351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d22e1343efb4ff6b31aba3a5075a758', 'request_id': 'req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.476745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d22e1343efb4ff6b31aba3a5075a758', 'request_id': 'req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.485806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d22e1343efb4ff6b31aba3a5075a758', 'request_id': 'req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.494528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:28.504082 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] The token cache is being invalidate because project 4d22e1343efb4ff6b31aba3a5075a758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:28.504555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.505997 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.508828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1339/2704] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:28 2022] DELETE /identity/v3/projects/4d22e1343efb4ff6b31aba3a5075a758 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:28.512722 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:28.524607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e832f7c-ff97-4349-a555-a8cc3dae41df service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:28.561720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:28.604932 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:28.605870 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:28.606158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:28.606459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] PATH_INFO: `/v3/users/39a892dcc6774704a735377e848e2244` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:28.607732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a892dcc6774704a735377e848e2244)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:28.609881 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:28.648667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:28.650802 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:28.666216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3aca-3547-4cc5-8abc-5a70b43ee285 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:28.671114 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:28.671975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:28.672144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a892dcc6774704a735377e848e2244'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.672282 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:28.672556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] PATH_INFO: `/v3/users/32a564c2e69a44ec97fa6996b259bd68` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:28.672930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a892dcc6774704a735377e848e2244'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.681650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a892dcc6774704a735377e848e2244'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.687430 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a564c2e69a44ec97fa6996b259bd68)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:28.689627 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:28.695113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a892dcc6774704a735377e848e2244'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.695748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a892dcc6774704a735377e848e2244'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.713883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1366/2705] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:28 2022] DELETE /identity/v3/users/39a892dcc6774704a735377e848e2244 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:28.743524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a564c2e69a44ec97fa6996b259bd68'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.750719 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a564c2e69a44ec97fa6996b259bd68'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.751408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a564c2e69a44ec97fa6996b259bd68'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.752116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a564c2e69a44ec97fa6996b259bd68'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.759687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a564c2e69a44ec97fa6996b259bd68'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:28.778010 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1340/2706] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:28 2022] DELETE /identity/v3/users/32a564c2e69a44ec97fa6996b259bd68 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:28.960066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:28.961533 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.005017 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.006441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.045187 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b0bd-0930-46b3-8329-5c7117ac429b admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.076411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e106d0-354a-48a4-82b2-7f3abde5e741 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.081988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.083577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.084259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.084259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] PATH_INFO: `/v3/projects/2ea5f3fb78634e92968a360820f8937a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.085381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea5f3fb78634e92968a360820f8937a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.087309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.096214 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:29.106366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.107340 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.107876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.108374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] PATH_INFO: `/v3/projects/f644afc12eb54b2eaeec92d9f154f490` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.119914 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f644afc12eb54b2eaeec92d9f154f490)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.121897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.137780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea5f3fb78634e92968a360820f8937a', 'request_id': 'req-19eab5a0-86cd-46d3-b2ec-bfa87393394b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.145671 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea5f3fb78634e92968a360820f8937a', 'request_id': 'req-19eab5a0-86cd-46d3-b2ec-bfa87393394b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.149820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:29.152502 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea5f3fb78634e92968a360820f8937a', 'request_id': 'req-19eab5a0-86cd-46d3-b2ec-bfa87393394b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.166816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] The token cache is being invalidate because project 2ea5f3fb78634e92968a360820f8937a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:29.167358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.168041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-19eab5a0-86cd-46d3-b2ec-bfa87393394b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.169499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f644afc12eb54b2eaeec92d9f154f490', 'request_id': 'req-bc870ced-b326-4914-86c4-1294df8c990d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.173232 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1341/2707] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:29 2022] DELETE /identity/v3/projects/2ea5f3fb78634e92968a360820f8937a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:29.174440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.174731 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.175009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.175569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f644afc12eb54b2eaeec92d9f154f490', 'request_id': 'req-bc870ced-b326-4914-86c4-1294df8c990d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.184132 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f644afc12eb54b2eaeec92d9f154f490', 'request_id': 'req-bc870ced-b326-4914-86c4-1294df8c990d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.194411 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.195651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.198660 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] The token cache is being invalidate because project f644afc12eb54b2eaeec92d9f154f490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:29.198949 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.199707 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-bc870ced-b326-4914-86c4-1294df8c990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:29.201960 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1367/2708] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:28 2022] DELETE /identity/v3/projects/f644afc12eb54b2eaeec92d9f154f490 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:29.206493 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29aebb-71b0-45c8-9ac3-cfd1fc03d735 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.206852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29aebb-71b0-45c8-9ac3-cfd1fc03d735 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.207251 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29aebb-71b0-45c8-9ac3-cfd1fc03d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.233807 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-fc29aebb-71b0-45c8-9ac3-cfd1fc03d735 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.235552 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fc29aebb-71b0-45c8-9ac3-cfd1fc03d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.275472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1342/2709] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:29.275472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.277023 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.297630 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1368/2710] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:29.304368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1abcf6-3e06-4c75-b978-4d1291687f84 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.304368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1abcf6-3e06-4c75-b978-4d1291687f84 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.304368 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1abcf6-3e06-4c75-b978-4d1291687f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.328876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6c1abcf6-3e06-4c75-b978-4d1291687f84 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.330344 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6c1abcf6-3e06-4c75-b978-4d1291687f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.339588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1369/2711] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:29.340895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.341188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.344270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.346859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1f9ef-e900-4943-85af-7157cec2b5d0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.350683 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.351464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.351747 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.352046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.353838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.362479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.363692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.371795 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1370/2712] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:29.372468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.382506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b065db-5c95-4312-a95a-388731cc2352 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.387345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.387990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.388335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.388615 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.389357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:29.389662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.391261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.403996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1371/2713] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:29.404876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.415384 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c160e-a901-465a-b653-23a5ffd96c18 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.419997 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.420640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.420925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.421206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.421912 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:29.422218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.423783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.426468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.427901 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.435627 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1372/2714] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:38:29.436483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.439181 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1343/2715] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:29.439968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.447017 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5427bc-c8a5-4e68-9527-1d14b493cbca admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.450542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06ce5-3e4d-449d-9466-8b053d0c62e9 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.451968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.452637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.452922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.453202 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.453890 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.455343 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.455804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.455989 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.456307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.456588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.457280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.459771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.484827 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1373/2716] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:29.488565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1344/2717] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:29.489525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.492642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.505135 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:29.510651 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:29.562269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3c8c-d702-4484-8114-e039baaff43d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.568327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.568931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.569255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.569479 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.570162 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.570786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee7653-0f65-440f-844b-d3162b821708 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.572105 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.575663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.576356 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.576643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.576919 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.577630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.579543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.594228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1374/2718] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:29.598888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.604054 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1345/2719] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:29.605611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.608668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98efc4-1aec-4307-b7eb-571ea4206858 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.613238 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.615034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.615034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.615532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.615710 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61e6ed-af80-4555-9773-66a2de0049c6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.616051 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.617647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.620598 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.621287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.621572 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.621852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.622607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.624293 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.627704 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1375/2720] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:29.631475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.634954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1346/2721] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:29.638605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.640937 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e225d2-9798-4596-8aeb-f07a36f486ae admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.645636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.646275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.646558 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.646833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.647555 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.648543 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2d0e6-d2a6-4737-b088-7e8e06ac9c33 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.649175 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.653196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.653830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.654112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.654391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.655255 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.656881 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.662041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1376/2722] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:29.666027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.673702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1347/2723] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:29.674706 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.675903 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ed806-f2ac-40b2-9006-a703a86e02e4 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.681269 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.682140 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.682423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.682699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] PATH_INFO: `/v3/projects/66e0db41a73c419ab17ad0ae7b03097e/users/4ba1f96d20484396bab123a7635bc735/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.685775 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cece33f-f3fc-4650-a1ab-e3baac89c3db admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.691868 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.693038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.693358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.693594 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] PATH_INFO: `/v3/projects/ee8c79da282347f49b7f8e54e0de87c4/users/6ccd7c0bed4841b2991dfce2ac533c6e/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.697556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e0db41a73c419ab17ad0ae7b03097e, user_id=4ba1f96d20484396bab123a7635bc735, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.700301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db29de0-a2f6-4e5b-95dd-f7b0ed230fe5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.709644 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8c79da282347f49b7f8e54e0de87c4, user_id=6ccd7c0bed4841b2991dfce2ac533c6e, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.712332 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e89d-2347-44b4-9eeb-e2367e64f12b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.713733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1377/2724] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:29 2022] PUT /identity/v3/projects/66e0db41a73c419ab17ad0ae7b03097e/users/4ba1f96d20484396bab123a7635bc735/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:29.718938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.719733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.719733 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.726245 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1348/2725] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:29 2022] PUT /identity/v3/projects/ee8c79da282347f49b7f8e54e0de87c4/users/6ccd7c0bed4841b2991dfce2ac533c6e/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:29.736101 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.736416 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.736707 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.737766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.739001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.765081 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] MFA Rules not processed for user `6ccd7c0bed4841b2991dfce2ac533c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:29.766579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:29.804325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1378/2726] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:29.814380 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.834113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1349/2727] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:29.838547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.849351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbb471-943a-431f-8631-bb2b761c6e70 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.858527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.859252 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.859463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.859887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.860456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.862423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.872203 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddac48d-7e43-4bcf-960d-fef184184ee8 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.875829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.876491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.876774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.877047 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.888537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.889040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1350/2728] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:29.892689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.892968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.902936 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1379/2729] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:29.913262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:29.955887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372d44-492c-4af8-bf13-2e917983c660 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:29.960689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:29.961378 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:29.961657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:29.961929 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:29.962615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:29.964597 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:29.984630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1351/2730] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:29 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:29.988572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:29.994093 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:30.001127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f93e9-2958-4f78-80b8-731511c95cb0 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.007204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.007856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.008164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.008437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.009150 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.010743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.021680 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1380/2731] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:30.025885 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.037984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4db6b-e190-4c35-8eb9-8d5ebb91c482 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.044935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.045993 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.046279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.046557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] PATH_INFO: `/v3/projects/20af94c0e3004cdd9d8345a4373eb93f/users/3645019d0d00488e89637273641231d6/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.063275 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20af94c0e3004cdd9d8345a4373eb93f, user_id=3645019d0d00488e89637273641231d6, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.066042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.082320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1352/2732] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:30 2022] PUT /identity/v3/projects/20af94c0e3004cdd9d8345a4373eb93f/users/3645019d0d00488e89637273641231d6/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:30.086536 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.096410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f25e0-f725-4b17-bf5f-1ce2fc681a17 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.156261 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.156930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.157209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.157490 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.158213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.159815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad72e7e-75c6-4383-8a26-61d05bbf8b0f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.174388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1381/2733] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:30.176003 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.192700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ab82-4cc8-46c1-9526-b7d29df98788 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.200457 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.201613 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.201962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.202340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] PATH_INFO: `/v3/projects/20af94c0e3004cdd9d8345a4373eb93f/users/3645019d0d00488e89637273641231d6/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.204510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20af94c0e3004cdd9d8345a4373eb93f, user_id=3645019d0d00488e89637273641231d6, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.207491 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.232063 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1353/2734] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:30 2022] PUT /identity/v3/projects/20af94c0e3004cdd9d8345a4373eb93f/users/3645019d0d00488e89637273641231d6/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:30.243010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.243300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.243599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.276618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] MFA Rules not processed for user `3645019d0d00488e89637273641231d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:30.277842 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:30.350226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1382/2735] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:30.363379 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.365268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:30.430843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3f5e-dbad-4fdd-859c-88a97466400a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.434528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.435169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.435449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.435723 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.445708 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.447345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096de69-5dd8-4509-9b7e-d15cbd612640 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.458153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1354/2736] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:30.542213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.545488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.545778 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.546059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.556189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42493c2c-5d78-4c6d-a695-c359293d3d33 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.560210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.561034 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.561494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.561919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.575042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] MFA Rules not processed for user `4ba1f96d20484396bab123a7635bc735`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:30.576301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:30.648362 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.656608 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.670716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1383/2737] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:30.686219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1355/2738] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:30.689510 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.705935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:30.781221 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086ee4-51f9-42ff-a58c-364ceafb6a6c service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.786631 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.787296 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.787559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.787834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.788559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.790464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.833569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1384/2739] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:30 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:30.838020 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.845668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:30.851893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e8f49-6ba0-4df4-9c63-822e9b0ee33b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.909283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.909870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.910151 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.910426 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.911604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.913557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.934816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1356/2740] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:30 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:30.938821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.949371 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2261dd-e900-4d8f-8e94-4ca6ec8c733e admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.953947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.954588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.954869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.955142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:30.955895 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:30.957557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:30.967913 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1385/2741] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:30.971874 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:30.982579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fa7-6c12-4d79-8000-b2fa3f2e3ef2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:30.987290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:30.988204 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:30.988488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:30.989394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] PATH_INFO: `/v3/projects/702f1ebdf6024cb49a0945988c414ce2/users/c6714a7c37474c449f79d4125b24b699/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:31.004262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702f1ebdf6024cb49a0945988c414ce2, user_id=c6714a7c37474c449f79d4125b24b699, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:31.006935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:31.019490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1357/2742] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:30 2022] PUT /identity/v3/projects/702f1ebdf6024cb49a0945988c414ce2/users/c6714a7c37474c449f79d4125b24b699/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:31.023327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:31.033256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203e05-bd6d-4ab7-bcb9-be15fd749684 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:31.088289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:31.088942 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:31.089225 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:31.089497 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:31.090258 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:31.092205 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559004d2-9d29-40ee-8f38-e04b44125986 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:31.102562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1386/2743] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:31.106647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:31.117630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1bea-db69-45c1-b010-8bcc93bb54b2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:31.122400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:31.123264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:31.123546 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:31.123823 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] PATH_INFO: `/v3/projects/702f1ebdf6024cb49a0945988c414ce2/users/c6714a7c37474c449f79d4125b24b699/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:31.125828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702f1ebdf6024cb49a0945988c414ce2, user_id=c6714a7c37474c449f79d4125b24b699, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:31.128591 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320acb70-fbde-4924-8322-d150876f7c95 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:31.138749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1358/2744] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:31 2022] PUT /identity/v3/projects/702f1ebdf6024cb49a0945988c414ce2/users/c6714a7c37474c449f79d4125b24b699/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:31.776458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:31.776753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:31.777035 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:31.806188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] MFA Rules not processed for user `c6714a7c37474c449f79d4125b24b699`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:31.808037 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:31.899869 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1387/2745] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:31.910065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:31.910347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:31.910654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:31.929635 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] MFA Rules not processed for user `4ba1f96d20484396bab123a7635bc735`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:31.930766 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:32.015954 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1359/2746] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:32.024419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:32.025835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:32.039502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:32.124832 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a058d7-529c-4317-998b-de19d5b036d5 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:32.133624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:32.134350 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:32.134641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:32.134919 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:32.143721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:32.145612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572b215-1774-4bbd-a3be-fcad6676943b service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:32.154989 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1388/2747] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:37.846045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:37.908892 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fbd67-d39b-4820-8223-a9bc88896278 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:37.913933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:37.914786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:37.915065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:37.915339 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] PATH_INFO: `/v3/users/6ccd7c0bed4841b2991dfce2ac533c6e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:37.916540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccd7c0bed4841b2991dfce2ac533c6e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:37.918463 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:37.920785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:37.964605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccd7c0bed4841b2991dfce2ac533c6e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:37.971290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccd7c0bed4841b2991dfce2ac533c6e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:37.971948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccd7c0bed4841b2991dfce2ac533c6e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:37.972586 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccd7c0bed4841b2991dfce2ac533c6e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:37.982264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccd7c0bed4841b2991dfce2ac533c6e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:37.999555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1360/2748] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:37 2022] DELETE /identity/v3/users/6ccd7c0bed4841b2991dfce2ac533c6e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:38.004146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.004659 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.004773 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.022345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:38.023847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.084670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1389/2749] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:38.094262 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:38.095634 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.156974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb569704-fcfd-49ef-905e-fe9ffdf2b0c9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:38.160601 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:38.161771 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.162051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.162323 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.172066 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:38.172946 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:38.182320 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1361/2750] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:38.504935 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:38.507138 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.519010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a21b6-0514-425b-99cb-6a0ad880a2cb None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:38.525484 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:38.526356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.526633 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.526910 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] PATH_INFO: `/v3/projects/ee8c79da282347f49b7f8e54e0de87c4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.528164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8c79da282347f49b7f8e54e0de87c4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:38.530306 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:38.588994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8c79da282347f49b7f8e54e0de87c4', 'request_id': 'req-6b23fc3c-421f-4431-813b-7bad1020576f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.594672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8c79da282347f49b7f8e54e0de87c4', 'request_id': 'req-6b23fc3c-421f-4431-813b-7bad1020576f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.607677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8c79da282347f49b7f8e54e0de87c4', 'request_id': 'req-6b23fc3c-421f-4431-813b-7bad1020576f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.621217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] The token cache is being invalidate because project ee8c79da282347f49b7f8e54e0de87c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:38.621406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.622006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.623813 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1390/2751] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:38 2022] DELETE /identity/v3/projects/ee8c79da282347f49b7f8e54e0de87c4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:38.624806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:38.626360 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.627275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:38.628749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.639268 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfd46-8535-47e6-b3f0-0787ea889dff service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:38.648698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:38.704388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23fc3c-421f-4431-813b-7bad1020576f admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:38.710765 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:38.710971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:38.711652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.711933 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.712071 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.712271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] PATH_INFO: `/v3/users/03014e54cea04cd9bc4542cc9873ed05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.712434 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.712535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] PATH_INFO: `/v3/users/3645019d0d00488e89637273641231d6` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.713465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03014e54cea04cd9bc4542cc9873ed05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:38.713712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3645019d0d00488e89637273641231d6)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:38.715424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:38.715620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:38.744797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:38.765486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3645019d0d00488e89637273641231d6'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.765684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03014e54cea04cd9bc4542cc9873ed05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.766292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3645019d0d00488e89637273641231d6'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.773251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03014e54cea04cd9bc4542cc9873ed05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.773904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03014e54cea04cd9bc4542cc9873ed05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.774027 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3645019d0d00488e89637273641231d6'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.774565 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03014e54cea04cd9bc4542cc9873ed05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.781377 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3645019d0d00488e89637273641231d6'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.782014 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e87802eb-189f-4185-9c64-85516d801e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3645019d0d00488e89637273641231d6'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.784730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03014e54cea04cd9bc4542cc9873ed05'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:38.800265 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1391/2752] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:38 2022] DELETE /identity/v3/users/3645019d0d00488e89637273641231d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:38.807039 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1362/2753] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:38 2022] DELETE /identity/v3/users/03014e54cea04cd9bc4542cc9873ed05 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:38.811602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451926-b216-4764-b28f-ce3971109505 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.811958 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451926-b216-4764-b28f-ce3971109505 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.812333 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451926-b216-4764-b28f-ce3971109505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.829197 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-65451926-b216-4764-b28f-ce3971109505 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:38.830468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-65451926-b216-4764-b28f-ce3971109505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.895889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1392/2754] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:38.905619 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:38.907065 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:38.978685 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1514-a5c3-472f-bef2-e34b701ecd23 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:38.982563 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:38.983214 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:38.983493 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:38.983905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:38.994373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:38.995866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c839-5be1-4230-acdd-5724f1e26b23 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.006467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1363/2755] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:39.112786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451926-b216-4764-b28f-ce3971109505 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.114782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-65451926-b216-4764-b28f-ce3971109505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:39.148456 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451926-b216-4764-b28f-ce3971109505 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.153805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.154666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.154945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.155745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] PATH_INFO: `/v3/projects/20af94c0e3004cdd9d8345a4373eb93f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.156606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=20af94c0e3004cdd9d8345a4373eb93f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.158525 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.244314 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:39.271088 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20af94c0e3004cdd9d8345a4373eb93f', 'request_id': 'req-c386afba-39b6-453b-b3a1-08a7af8503ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.279483 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20af94c0e3004cdd9d8345a4373eb93f', 'request_id': 'req-c386afba-39b6-453b-b3a1-08a7af8503ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.295337 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20af94c0e3004cdd9d8345a4373eb93f', 'request_id': 'req-c386afba-39b6-453b-b3a1-08a7af8503ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.312804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] The token cache is being invalidate because project 20af94c0e3004cdd9d8345a4373eb93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:39.313096 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.314897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.320324 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1393/2756] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:39 2022] DELETE /identity/v3/projects/20af94c0e3004cdd9d8345a4373eb93f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:39.327615 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526819ab-029b-41e6-bc54-b426ebea1492 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.328305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526819ab-029b-41e6-bc54-b426ebea1492 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.329739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526819ab-029b-41e6-bc54-b426ebea1492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.355785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-526819ab-029b-41e6-bc54-b426ebea1492 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:39.358229 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-526819ab-029b-41e6-bc54-b426ebea1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:39.389414 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.391081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:39.457381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1364/2757] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:39.467623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.468281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.468999 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.484158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386afba-39b6-453b-b3a1-08a7af8503ad admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.489390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.489651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:39.490439 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.490565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.490797 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] PATH_INFO: `/v3/projects/176ef65eb3e34bd78f5aee1285122d67` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.490935 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:39.492110 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176ef65eb3e34bd78f5aee1285122d67)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.494405 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.499784 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1365/2758] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:39.503888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.513748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4e38-7a1f-44d1-bc81-08d4247ef407 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.518475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.519106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.519384 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.519654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.520392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:39.520687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.522304 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.534353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1366/2759] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:39.538791 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.549157 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac288-5aba-4409-977c-2bb3f181481a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.551872 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176ef65eb3e34bd78f5aee1285122d67', 'request_id': 'req-e7f805b0-aa20-4d81-af6c-70660512a743'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.558786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176ef65eb3e34bd78f5aee1285122d67', 'request_id': 'req-e7f805b0-aa20-4d81-af6c-70660512a743'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.566367 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176ef65eb3e34bd78f5aee1285122d67', 'request_id': 'req-e7f805b0-aa20-4d81-af6c-70660512a743'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.576319 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:39.579386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] The token cache is being invalidate because project 176ef65eb3e34bd78f5aee1285122d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:39.579670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.580381 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:39.581931 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1394/2760] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:39 2022] DELETE /identity/v3/projects/176ef65eb3e34bd78f5aee1285122d67 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:39.618390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.619076 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.619358 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.619640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.620428 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.622394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.665273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1367/2761] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:39 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:39.669220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.674186 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:39.701972 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f805b0-aa20-4d81-af6c-70660512a743 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.771207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:39.797892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.798503 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.798804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.799066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.799804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.802413 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.828569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1395/2762] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:39 2022] POST /identity/v3/users => generated 305 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:39.830046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.840829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b60d-27f0-40c5-9e97-06878a852071 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.846108 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.846895 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.847301 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.847669 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.849056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.851050 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.862263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1368/2763] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:39.867003 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.884566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ce94-19ca-4c72-ab69-04221fae7518 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.890085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.890753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.891032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.891303 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.892061 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.893666 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1caec0-4169-4b56-b101-a66ca210c6cf admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.906956 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1396/2764] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:39.908307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:39.919425 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4005-365f-4d88-b08b-f538a50335f2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:39.924220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:39.925093 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.925370 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.925643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] PATH_INFO: `/v3/projects/16d5573380d74180a61a91b0ed308bf5/users/22ea3bd435524525b981daceccfe0fa7/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.941269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d5573380d74180a61a91b0ed308bf5, user_id=22ea3bd435524525b981daceccfe0fa7, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:39.944094 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:39.958192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1369/2765] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:39 2022] PUT /identity/v3/projects/16d5573380d74180a61a91b0ed308bf5/users/22ea3bd435524525b981daceccfe0fa7/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:39.968334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:39.968624 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:39.968901 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:39.997374 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] MFA Rules not processed for user `22ea3bd435524525b981daceccfe0fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:39.998646 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:40.061886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1397/2766] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:40.066277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.128340 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940aff-4c5b-47ee-9873-b3481c355218 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.133200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.133848 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.134155 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.134427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.135105 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.137070 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.166177 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1370/2767] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:40 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:40.170343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.181837 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154af6b-b1a2-4801-863d-580a8c5bb9e3 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.238577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.239280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.239563 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.239838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.240565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.242475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.262803 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1398/2768] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:40 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:40.266745 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.278342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b3c7-af17-46fb-9f55-51ed1652023d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.282972 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.283620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.283900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.284217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.284940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.287142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.297433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1371/2769] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:40.301793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.311959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851036f-4a3a-46ef-bb15-ff7b545f8d81 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.316541 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.317406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.317690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.317961 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] PATH_INFO: `/v3/projects/1a1e35c0e6674a15a3d60e144826cec4/users/3946df80c12c4ef28a9b313f5810e5c5/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.332861 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1e35c0e6674a15a3d60e144826cec4, user_id=3946df80c12c4ef28a9b313f5810e5c5, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.335494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.348954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1399/2770] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:40 2022] PUT /identity/v3/projects/1a1e35c0e6674a15a3d60e144826cec4/users/3946df80c12c4ef28a9b313f5810e5c5/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:40.353018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.362912 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890adb-856f-4406-ab41-0fe4a07fcc80 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.408536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:40.419235 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.419887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.420390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.420695 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.421673 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.423306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799f0b-d88e-43a4-bc4b-d16db0162ea4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.436476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1372/2771] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:40.437556 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.451217 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4cf8-3523-4519-833d-7e5fc6483b35 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.455859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.456857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.457137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.457941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] PATH_INFO: `/v3/projects/1a1e35c0e6674a15a3d60e144826cec4/users/3946df80c12c4ef28a9b313f5810e5c5/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.459905 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1e35c0e6674a15a3d60e144826cec4, user_id=3946df80c12c4ef28a9b313f5810e5c5, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.462590 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.473169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1400/2772] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:40 2022] PUT /identity/v3/projects/1a1e35c0e6674a15a3d60e144826cec4/users/3946df80c12c4ef28a9b313f5810e5c5/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:40.484970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.485263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.485542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.512064 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] MFA Rules not processed for user `3946df80c12c4ef28a9b313f5810e5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:40.513244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:40.583536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1373/2773] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:40.594741 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.596945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:40.609375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:40.670172 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee5eb-1fe1-41c4-81cf-821a5f8326d7 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.673829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.674449 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.674729 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.675002 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.685730 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.687364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.698984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1401/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:40.850327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:40.860853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa8002-e5b8-4130-99eb-5b64cdc16716 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:40.865555 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:40.866200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:40.866481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:40.866756 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:40.924196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:40.925688 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:40.935588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1374/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:46.109516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:46.110959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:46.122777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75fe2-f8cf-40c9-bff3-5167594d8ac5 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:46.126442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:46.127072 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.127356 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.127632 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.129450 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:46.140351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:46.194426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:46.196078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ef160-1435-4b0d-b6ee-47870c438c62 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:46.209381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94d2d5-c829-457a-ab2e-f069e6827200 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:46.210645 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1402/2776] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:46.217680 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:46.218674 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.219051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.219443 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] PATH_INFO: `/v3/users/22ea3bd435524525b981daceccfe0fa7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.220951 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ea3bd435524525b981daceccfe0fa7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:46.223714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:46.237969 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:46.274607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ea3bd435524525b981daceccfe0fa7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.281641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ea3bd435524525b981daceccfe0fa7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.282413 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ea3bd435524525b981daceccfe0fa7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.283018 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ea3bd435524525b981daceccfe0fa7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.294040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ea3bd435524525b981daceccfe0fa7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.312130 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1375/2777] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:46 2022] DELETE /identity/v3/users/22ea3bd435524525b981daceccfe0fa7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:46.316874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.317226 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.317504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.335068 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:46.336086 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:46.402727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1403/2778] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:46.412727 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:46.414210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:46.472728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168dafc-e68c-44b1-ba8e-7e5208ca746a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:46.477477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:46.478113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.478389 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.478659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.488297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:46.489893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:46.500269 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1376/2779] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:46.812755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:46.814576 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:46.828353 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf437-395a-4ba9-a492-731e72984f57 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:46.834379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:46.835366 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.835784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.836195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] PATH_INFO: `/v3/projects/16d5573380d74180a61a91b0ed308bf5` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.837535 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d5573380d74180a61a91b0ed308bf5)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:46.839701 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:46.887184 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:46.896211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d5573380d74180a61a91b0ed308bf5', 'request_id': 'req-176ebd60-4c3b-4317-a137-2ebd5a45d577'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.902891 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d5573380d74180a61a91b0ed308bf5', 'request_id': 'req-176ebd60-4c3b-4317-a137-2ebd5a45d577'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.911309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d5573380d74180a61a91b0ed308bf5', 'request_id': 'req-176ebd60-4c3b-4317-a137-2ebd5a45d577'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.923233 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] The token cache is being invalidate because project 16d5573380d74180a61a91b0ed308bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:46.923527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.924212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:46.925815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1404/2780] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:46 2022] DELETE /identity/v3/projects/16d5573380d74180a61a91b0ed308bf5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:46.929783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:46.939539 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0057ab2-744b-4881-a2a4-026c8554b3f9 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:46.996488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:46.997351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:46.997628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:46.997906 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] PATH_INFO: `/v3/users/3946df80c12c4ef28a9b313f5810e5c5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:46.999080 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3946df80c12c4ef28a9b313f5810e5c5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:47.001021 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:47.038547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:47.048624 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3946df80c12c4ef28a9b313f5810e5c5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.056325 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3946df80c12c4ef28a9b313f5810e5c5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.056927 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3946df80c12c4ef28a9b313f5810e5c5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.057526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3946df80c12c4ef28a9b313f5810e5c5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.065273 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1dcb398d-f57b-4fe9-ba19-758d9786d12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3946df80c12c4ef28a9b313f5810e5c5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.085498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1377/2781] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:46 2022] DELETE /identity/v3/users/3946df80c12c4ef28a9b313f5810e5c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:47.595975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:47.602254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:47.614438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ebd60-4c3b-4317-a137-2ebd5a45d577 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:47.670115 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:47.670970 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:47.671250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:47.671526 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] PATH_INFO: `/v3/projects/1a1e35c0e6674a15a3d60e144826cec4` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:47.672724 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1e35c0e6674a15a3d60e144826cec4)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:47.674636 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:47.722430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1e35c0e6674a15a3d60e144826cec4', 'request_id': 'req-5377f2ec-dde8-4579-a395-9eaa739ea6b7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.729001 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1e35c0e6674a15a3d60e144826cec4', 'request_id': 'req-5377f2ec-dde8-4579-a395-9eaa739ea6b7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.737883 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1e35c0e6674a15a3d60e144826cec4', 'request_id': 'req-5377f2ec-dde8-4579-a395-9eaa739ea6b7'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.752142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] The token cache is being invalidate because project 1a1e35c0e6674a15a3d60e144826cec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:47.752532 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.753782 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5377f2ec-dde8-4579-a395-9eaa739ea6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:47.755512 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1405/2782] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:47 2022] DELETE /identity/v3/projects/1a1e35c0e6674a15a3d60e144826cec4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:47.760524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:47.761015 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:47.761347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:47.779648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:47.781333 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:47.843393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1378/2783] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:47.853174 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:47.853465 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:47.853744 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:47.871755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:47.873060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:47.882323 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1406/2784] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:47.886843 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:47.897217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b168-a1ad-4ae4-a1d6-bef03049ef42 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:47.902297 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:47.902945 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:47.903257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:47.903557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:47.904317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:47.904626 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:47.906283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:47.919877 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1379/2785] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:47.924169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:47.933955 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6b589-27b9-4a9d-9a89-7fb58140e3c3 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:47.939010 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:47.939692 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:47.940165 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:47.940482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:47.941170 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:47.943295 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:47.973783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1407/2786] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:47 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:47.976396 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:47.986666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99a51-9ea1-4b2a-a6dc-0a0eda72d83e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.043807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.044501 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.044783 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.045060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.045740 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.047670 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.067940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1380/2787] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:47 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:48.072045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.082994 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93034c72-dd0c-4dca-9f80-627d0a793e41 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.091127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.091736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.092038 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.092355 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.093092 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.094748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.109056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1408/2788] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:48.112925 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.123614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641fd58-54e2-47a2-9817-61a67dbe3a8e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.128429 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.129085 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.130551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.130834 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.131573 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.133219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d8861-a144-402e-959c-ec30975b8d4a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.147423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1381/2789] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:48.148649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.158678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bededb2-eea4-46fe-ae16-2a0d1f4740c8 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.163291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.164198 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.164482 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.164758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] PATH_INFO: `/v3/projects/06c09414b95f438b857b3d13e0233127/users/f12a3c59267542f880b335680cd71678/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.181647 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c09414b95f438b857b3d13e0233127, user_id=f12a3c59267542f880b335680cd71678, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.184477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.187824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:48.201969 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1409/2790] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:48 2022] PUT /identity/v3/projects/06c09414b95f438b857b3d13e0233127/users/f12a3c59267542f880b335680cd71678/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:48.212703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.213004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.213290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.242530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] MFA Rules not processed for user `f12a3c59267542f880b335680cd71678`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:48.243772 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:48.249468 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:48.315659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1382/2791] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:48.346154 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.347892 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:48.404329 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9cc45-e445-4d20-9b42-dbe726769264 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.408045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.408694 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.408975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.409248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.417564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.419006 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7228b-bc57-43c3-b8ae-f04248e91fbc service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.427682 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1410/2792] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:48.441244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.503911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbe03f-be53-491a-8017-ba563bc75052 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.509166 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.510069 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.510351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.510625 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] PATH_INFO: `/v3/users/f12a3c59267542f880b335680cd71678` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.511838 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12a3c59267542f880b335680cd71678)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.513794 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.567900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12a3c59267542f880b335680cd71678'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:48.574820 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12a3c59267542f880b335680cd71678'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:48.575524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12a3c59267542f880b335680cd71678'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:48.576198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12a3c59267542f880b335680cd71678'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:48.585422 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12a3c59267542f880b335680cd71678'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:48.604005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1383/2793] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:48 2022] DELETE /identity/v3/users/f12a3c59267542f880b335680cd71678 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:48.608287 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.608855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.608967 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.626721 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:48.627933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:48.693137 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1411/2794] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:48.703347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:48.705687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:48.736938 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:48.766659 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8632-7bb2-4392-ba0f-61c8c4319e58 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:48.770607 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:48.771329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:48.771614 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:48.772113 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:48.781424 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:48.782867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f5669-aaba-4cec-9ee0-c98baa3a592b service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:48.792604 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1384/2795] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:49.161975 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.163478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:49.179387 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691587b0-14bc-48b6-9625-69c1a0a3b2f7 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.184180 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.185036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.185325 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.185577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] PATH_INFO: `/v3/projects/06c09414b95f438b857b3d13e0233127` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.186791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c09414b95f438b857b3d13e0233127)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.188715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.235745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c09414b95f438b857b3d13e0233127', 'request_id': 'req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:49.241077 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c09414b95f438b857b3d13e0233127', 'request_id': 'req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:49.249142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c09414b95f438b857b3d13e0233127', 'request_id': 'req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:49.260189 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] The token cache is being invalidate because project 06c09414b95f438b857b3d13e0233127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:49.260475 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:49.261107 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-4d3310df-b07d-4a0c-a3de-8be49ae6f3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:49.262643 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1412/2796] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:49 2022] DELETE /identity/v3/projects/06c09414b95f438b857b3d13e0233127 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:49.267610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.267900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.268290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.287221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:49.288456 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:49.349888 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1385/2797] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:49.358835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a131-7c25-497a-a934-959004a697db None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.359122 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a131-7c25-497a-a934-959004a697db None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.359403 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a131-7c25-497a-a934-959004a697db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.379793 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-f1e6a131-7c25-497a-a934-959004a697db None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:49.381097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-f1e6a131-7c25-497a-a934-959004a697db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:49.389723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1413/2798] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:49.394051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.405337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb4901-a9ea-47d2-ba3e-e37c46a1decd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.411840 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.412589 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.412866 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.413134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.413861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:49.414164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.415795 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.434154 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1386/2799] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:49.435718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6a131-7c25-497a-a934-959004a697db None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.446275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6a131-7c25-497a-a934-959004a697db None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.452129 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.452938 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.453270 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.453749 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.454637 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.456732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.471798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:49.487598 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1414/2800] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:49.491884 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.502173 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08227-12db-47ff-b0ab-485a340093e4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.559270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.559924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.560230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.560505 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.561210 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.563106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.585773 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1387/2801] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:49.590494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.600814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3932f2-b1e1-4846-be07-0ba542386170 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.605606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.606249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.606531 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.606806 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.607530 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.609227 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.619501 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1415/2802] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:49.623390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.633984 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e1f4-21a7-4783-8a5a-e4ab394dd19a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.639196 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.639836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.640246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.640612 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.641381 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.643357 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9a9e-1dd0-4f2c-8478-548187700ee7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.655839 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1388/2803] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:49.660454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.670438 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aaa21-046d-4ee5-995e-aaba415415fb admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.675158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.676106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.676389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.676664 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] PATH_INFO: `/v3/projects/278de375ca454099aca8b75d0c354aaf/users/f91873f732cf4e9e9202e52b26f09156/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.691054 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=278de375ca454099aca8b75d0c354aaf, user_id=f91873f732cf4e9e9202e52b26f09156, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.694244 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.706834 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1416/2804] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:49 2022] PUT /identity/v3/projects/278de375ca454099aca8b75d0c354aaf/users/f91873f732cf4e9e9202e52b26f09156/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:49.717667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.717962 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.718246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.744616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] MFA Rules not processed for user `f91873f732cf4e9e9202e52b26f09156`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:49.745841 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:49.773528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:49.814345 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1389/2805] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:49.819516 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.881758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7de-197f-4ca4-9ac5-1ebecfbed15a admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.886390 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.887036 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.887319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.887597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.888307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.890215 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:49.915302 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1417/2806] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:49.919556 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:49.930237 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f952c-7d56-4b94-9303-fdbba1f4256c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:49.987394 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:49.988107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:49.988399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:49.989402 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:49.990100 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:49.992127 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.012359 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1390/2807] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:49 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:38:50.016453 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:50.027787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef44c3-50d4-48a7-bcec-eda6e6283ab9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:50.033720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:50.034430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.034759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.035218 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.035985 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:50.037619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.048866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1418/2808] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:50.053623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:50.064423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c97f-0c49-404a-a429-8268717dcfe0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:50.069956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:50.070829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.071153 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.071458 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] PATH_INFO: `/v3/projects/245bc60b35be4666a992ec9f0b9b2154/users/360bc6b2a76049bcbc94032d3651653f/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.086643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245bc60b35be4666a992ec9f0b9b2154, user_id=360bc6b2a76049bcbc94032d3651653f, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:50.089454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.102577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1391/2809] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:50 2022] PUT /identity/v3/projects/245bc60b35be4666a992ec9f0b9b2154/users/360bc6b2a76049bcbc94032d3651653f/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:50.106524 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:50.117650 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359d4f0-00d1-4337-a1ba-f00938a1e251 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:50.175698 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:50.176991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.177304 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.177574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.178459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:50.179930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4690-dba3-4871-9523-37f45d4b73d1 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.190673 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1419/2810] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:38:50.195403 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:50.206511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dcfb8-1393-44fd-8f28-5d6cb989f005 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:50.211829 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:50.218175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.218175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.218175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] PATH_INFO: `/v3/projects/245bc60b35be4666a992ec9f0b9b2154/users/360bc6b2a76049bcbc94032d3651653f/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.218175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245bc60b35be4666a992ec9f0b9b2154, user_id=360bc6b2a76049bcbc94032d3651653f, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:50.218175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.229336 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1392/2811] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:50 2022] PUT /identity/v3/projects/245bc60b35be4666a992ec9f0b9b2154/users/360bc6b2a76049bcbc94032d3651653f/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:50.239918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.240412 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.240786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.269169 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] MFA Rules not processed for user `360bc6b2a76049bcbc94032d3651653f`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:50.270697 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:50.287829 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:50.340148 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1420/2812] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:50.351475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:50.353192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:50.409218 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dec3-8b14-491c-b861-6bd242738371 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:50.413362 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:50.414051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:50.414254 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:50.414528 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:50.450863 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:50.479347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:50.480816 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84901a6b-8ec3-44bb-abd6-996db909edfc service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:50.490811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1393/2813] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:53.029566 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:53.091373 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a600-1127-4d9b-aa57-d849f3673a76 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:53.095862 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:53.096791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:53.097075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:53.097343 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] PATH_INFO: `/v3/users/f91873f732cf4e9e9202e52b26f09156` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:53.099126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91873f732cf4e9e9202e52b26f09156)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:53.101392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:53.147824 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91873f732cf4e9e9202e52b26f09156'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.148690 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91873f732cf4e9e9202e52b26f09156'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.155798 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91873f732cf4e9e9202e52b26f09156'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.163131 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91873f732cf4e9e9202e52b26f09156'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.163747 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91873f732cf4e9e9202e52b26f09156'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.182252 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1421/2814] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:53 2022] DELETE /identity/v3/users/f91873f732cf4e9e9202e52b26f09156 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:53.187115 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:53.187622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:53.187622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:53.205044 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:53.206242 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:53.295060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1394/2815] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:53.304921 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:53.306404 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:53.348809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:53.373206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19346ba-5610-40a9-9acd-2e915a39ba99 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:53.376888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:53.377529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:53.377808 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:53.378081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:53.387769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:53.389273 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:53.399200 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1422/2816] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:53.783836 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:53.785300 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:53.797442 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0110-7d06-40bc-a7de-3d51aa2fedb3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:53.802643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:53.804353 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:53.804742 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:53.804970 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] PATH_INFO: `/v3/projects/278de375ca454099aca8b75d0c354aaf` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:53.806700 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278de375ca454099aca8b75d0c354aaf)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:53.808259 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:53.865338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278de375ca454099aca8b75d0c354aaf', 'request_id': 'req-74424c4e-5c7b-4135-88ce-b5cee472f260'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.875061 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278de375ca454099aca8b75d0c354aaf', 'request_id': 'req-74424c4e-5c7b-4135-88ce-b5cee472f260'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.881265 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278de375ca454099aca8b75d0c354aaf', 'request_id': 'req-74424c4e-5c7b-4135-88ce-b5cee472f260'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.893241 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] The token cache is being invalidate because project 278de375ca454099aca8b75d0c354aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:53.893533 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.894180 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:53.896486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1395/2817] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:53 2022] DELETE /identity/v3/projects/278de375ca454099aca8b75d0c354aaf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:53.900547 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:53.912074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3068eec-c657-4e75-bd47-62efeed98245 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:53.973245 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:53.974805 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:53.975194 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:53.975561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] PATH_INFO: `/v3/users/360bc6b2a76049bcbc94032d3651653f` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:53.977642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360bc6b2a76049bcbc94032d3651653f)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:53.979879 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.030142 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360bc6b2a76049bcbc94032d3651653f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.030818 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360bc6b2a76049bcbc94032d3651653f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.038431 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360bc6b2a76049bcbc94032d3651653f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.046499 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360bc6b2a76049bcbc94032d3651653f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.047111 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360bc6b2a76049bcbc94032d3651653f'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.065586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1423/2818] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:53 2022] DELETE /identity/v3/users/360bc6b2a76049bcbc94032d3651653f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:54.149264 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.150992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.164814 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74424c4e-5c7b-4135-88ce-b5cee472f260 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.237949 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:54.250209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.251511 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.252199 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.252479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] PATH_INFO: `/v3/users/475ec07f624d4d32a4e3d94e92234a33` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.253694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=475ec07f624d4d32a4e3d94e92234a33)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.256251 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.313276 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475ec07f624d4d32a4e3d94e92234a33'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.328167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475ec07f624d4d32a4e3d94e92234a33'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.328167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475ec07f624d4d32a4e3d94e92234a33'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.328167 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475ec07f624d4d32a4e3d94e92234a33'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.340530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475ec07f624d4d32a4e3d94e92234a33'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.365348 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1396/2819] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:38:54 2022] DELETE /identity/v3/users/475ec07f624d4d32a4e3d94e92234a33 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:54.384156 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.385889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.423066 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d04b67-37d1-4e34-9000-8279c464d1b5 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.489769 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:54.500766 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.502249 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.502655 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.502948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] PATH_INFO: `/v3/projects/245bc60b35be4666a992ec9f0b9b2154` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.505282 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245bc60b35be4666a992ec9f0b9b2154)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.507489 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.564042 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.565827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.572386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245bc60b35be4666a992ec9f0b9b2154', 'request_id': 'req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.578363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245bc60b35be4666a992ec9f0b9b2154', 'request_id': 'req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.586067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c7138-f1b6-4202-bc7f-f3837b177153 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.586945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245bc60b35be4666a992ec9f0b9b2154', 'request_id': 'req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.600206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] The token cache is being invalidate because project 245bc60b35be4666a992ec9f0b9b2154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:54.600500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.601421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-0edfe4d4-cf70-4c9f-a4d5-17fa81a6e466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.602990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1424/2820] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:54 2022] DELETE /identity/v3/projects/245bc60b35be4666a992ec9f0b9b2154 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:54.607784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51722bf-458a-4f7a-afe3-8a21cdef5a0a None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.608228 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51722bf-458a-4f7a-afe3-8a21cdef5a0a None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.608588 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51722bf-458a-4f7a-afe3-8a21cdef5a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.627887 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e51722bf-458a-4f7a-afe3-8a21cdef5a0a None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:54.629195 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e51722bf-458a-4f7a-afe3-8a21cdef5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.656126 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.656983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.657260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.657530 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] PATH_INFO: `/v3/projects/94a2ff800a064d2e9f17b9f79b698b9a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.658703 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a2ff800a064d2e9f17b9f79b698b9a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.660651 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.694916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1425/2821] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:54.703874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.704318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.704603 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.716638 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a2ff800a064d2e9f17b9f79b698b9a', 'request_id': 'req-3acf3ac4-397e-49da-b2cc-7ae20313d781'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.723583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:54.724107 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a2ff800a064d2e9f17b9f79b698b9a', 'request_id': 'req-3acf3ac4-397e-49da-b2cc-7ae20313d781'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.724833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.730132 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a2ff800a064d2e9f17b9f79b698b9a', 'request_id': 'req-3acf3ac4-397e-49da-b2cc-7ae20313d781'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.743819 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] The token cache is being invalidate because project 94a2ff800a064d2e9f17b9f79b698b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:38:54.744142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.744803 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3acf3ac4-397e-49da-b2cc-7ae20313d781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:38:54.746347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1397/2822] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:38:54 2022] DELETE /identity/v3/projects/94a2ff800a064d2e9f17b9f79b698b9a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:38:54.751438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf70f-08fe-40bb-9fb5-46a52fd10b09 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.751725 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf70f-08fe-40bb-9fb5-46a52fd10b09 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.751983 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf70f-08fe-40bb-9fb5-46a52fd10b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.760757 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:54.774525 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e66bf70f-08fe-40bb-9fb5-46a52fd10b09 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:54.775739 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e66bf70f-08fe-40bb-9fb5-46a52fd10b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.790529 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1426/2823] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:54.794423 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.803855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c740-76a9-461f-a2eb-0203d1ffb248 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.809237 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.809880 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.810161 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.810437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.811160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80139) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:54.811464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.813143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.828859 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1427/2824] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:54.830209 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.837351 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1398/2825] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:54.845185 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.845472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.845800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.846580 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f28e-9860-4b39-a149-9d516ea5a469 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.852179 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.852856 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.853141 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.853415 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.854106 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.856029 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.866079 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:54.867277 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:54.869397 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:54.878887 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1399/2826] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:54.884168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.895048 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1428/2827] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:54.895991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.897125 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856936ba-a9a2-4ccb-a034-116bcc0a8781 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.958472 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.959226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.959506 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.959780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.959888 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2609-e740-4b2d-9eda-922d5fa4d14d admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.960540 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:38:54.960845 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.962465 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.965327 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.965980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.966257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.966527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] PATH_INFO: `/v3/users` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.967206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:54.969143 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:54.975726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1400/2828] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:38:54.980667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.995602 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1429/2829] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:54.995801 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f805ca-d706-4605-b092-4476744e35d4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:54.996623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:54.997569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:54.998329 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:54.998616 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:54.998893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:54.999579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.001527 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.006458 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682ab8-194a-4dbe-abe6-22950ae75853 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.011759 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.012469 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.012715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.012990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.013709 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.015441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.031866 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1430/2830] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:55.032534 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1401/2831] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:38:54 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:55.032642 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.032936 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.040777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e003-2020-4ee5-a75a-e53029bd1c50 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.094307 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947526-8ff4-46e2-a657-0636ac6fbfb1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.099364 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.099535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.100045 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.100202 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.100335 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.100454 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.100638 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.100762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.101611 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.101730 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.103207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.103536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.113120 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1431/2832] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:55.118212 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.119620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:55.125568 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1402/2833] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:38:55 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:38:55.129311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.130098 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18536-6d03-471b-bc8d-5200512418ba admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.134710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.135583 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.135867 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.136191 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] PATH_INFO: `/v3/projects/67b6515d1a9f462d940ff85e6e4a243d/users/fbb3e0a13ac34245a36e4dfb2f81df2d/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.139503 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafc864-90e2-4fdc-b72d-89b9ebc90a0b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.144263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.144911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.145200 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.145497 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.146224 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.147827 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.151768 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b6515d1a9f462d940ff85e6e4a243d, user_id=fbb3e0a13ac34245a36e4dfb2f81df2d, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.154466 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585435a3-e9a8-404b-b17a-59324687125c admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.157960 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1403/2834] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:55.162508 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.171922 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1432/2835] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:55 2022] PUT /identity/v3/projects/67b6515d1a9f462d940ff85e6e4a243d/users/fbb3e0a13ac34245a36e4dfb2f81df2d/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:55.172435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d34ab3-f971-4d48-a1ed-7eaf142527c5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.177334 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.177625 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.177909 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.194426 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:55.195613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:55.231961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.232663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.232948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.233221 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.233948 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.235547 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.235984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:55.249056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1404/2836] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:38:55.250665 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.258345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1433/2837] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:55.262872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac184e-57dd-47b9-8f50-a5837bc87f83 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.267567 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.268893 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.269039 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:55.270317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.270596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.270870 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] PATH_INFO: `/v3/projects/c5ee53b145944494b79c33cff7a86c72/users/104b4ec7f3924f0ba5d505ddbb0da19f/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.286666 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ee53b145944494b79c33cff7a86c72, user_id=104b4ec7f3924f0ba5d505ddbb0da19f, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.289392 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b7270-d611-4f38-b322-cda3607dec0f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.302648 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1405/2838] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:38:55 2022] PUT /identity/v3/projects/c5ee53b145944494b79c33cff7a86c72/users/104b4ec7f3924f0ba5d505ddbb0da19f/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:38:55.307677 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.307967 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.308303 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.328316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:55.329292 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7523bf-c0f2-4655-b193-81f8d31ceeab None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.329536 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:55.380717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.381395 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.381672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.381941 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.390467 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1406/2839] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:38:55.406040 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:55.417051 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbe538-7f96-4002-9332-231fa1e57fe7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:55.420774 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:55.421441 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:55.421726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:55.422005 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:55.431569 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.433749 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c0bb-d410-409c-9fad-4d86b47d681d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.443338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1407/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:55.445053 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:55.446618 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:55.456653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1434/2841] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 14:38:56.605148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287c26-62c1-4ece-bdf4-ae392902132f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:56.605148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287c26-62c1-4ece-bdf4-ae392902132f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:56.605148 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287c26-62c1-4ece-bdf4-ae392902132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:56.633009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-00287c26-62c1-4ece-bdf4-ae392902132f None None] MFA Rules not processed for user `fbb3e0a13ac34245a36e4dfb2f81df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:56.634295 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-00287c26-62c1-4ece-bdf4-ae392902132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:56.681393 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:56.711657 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1408/2842] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:56.723628 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:56.725652 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:56.787906 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:38:56.792204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5d2cc-e512-408e-8c6e-775c20aca453 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:56.797294 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:56.798945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:56.798945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:56.798945 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:56.808085 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:56.809670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:56.819689 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1435/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:38:58.327047 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758be01-86b7-4d50-8bee-22f02600de2a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:58.327869 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758be01-86b7-4d50-8bee-22f02600de2a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:58.328328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758be01-86b7-4d50-8bee-22f02600de2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:58.352146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5758be01-86b7-4d50-8bee-22f02600de2a None None] MFA Rules not processed for user `fbb3e0a13ac34245a36e4dfb2f81df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:38:58.353377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5758be01-86b7-4d50-8bee-22f02600de2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:58.375968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1409/2844] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:38:59.586874 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:38:59.588539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:59.701925 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4b88-a4b1-4395-b4eb-375766cf5572 service cinder] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:38:59.712468 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:38:59.713147 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:38:59.713442 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:38:59.713706 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:38:59.715504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:38:59.730360 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:38:59.731996 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:38:59.753522 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1436/2845] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:38:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:00.648889 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:00.649988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:00.650504 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:00.695630 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] MFA Rules not processed for user `104b4ec7f3924f0ba5d505ddbb0da19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:00.697247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:00.794290 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1410/2846] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:00.798683 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:00.809815 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838965c-aa0c-4f20-854e-90491f1a5433 service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:00.814309 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:00.815062 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:00.815346 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:00.815620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:00.816332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:00.818459 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:00.846561 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1437/2847] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:39:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:39:00.850376 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:00.863844 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7104ac-3c70-4b42-9dac-dbb130be49a8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:00.927052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:00.927400 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:00.927686 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:00.927961 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:00.928842 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:00.930780 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:00.954122 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1411/2848] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:39:00 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:39:00.958385 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:00.968753 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275c89-4a59-40b2-9640-584995381e44 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:00.973948 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:00.974597 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:00.974875 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:00.975144 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:00.975865 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:00.977779 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:00.988684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1438/2849] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:39:00.992762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:01.003328 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12cf0-eb7b-4d24-91a7-ea69cb717b04 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:01.008475 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:01.009455 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:01.009734 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:01.010009 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] PATH_INFO: `/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e/users/075e6221fae641718121199e08ebd144/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:01.026761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa70317112b1410d8189a1b8b2ed0f2e, user_id=075e6221fae641718121199e08ebd144, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:01.030620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:01.047822 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1412/2850] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:39:00 2022] PUT /identity/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e/users/075e6221fae641718121199e08ebd144/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:39:01.054127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:01.066470 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79053-b860-410c-a338-2c0f37e26dde admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:01.139213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:01.140256 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:01.140537 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:01.140814 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:01.141569 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:01.143222 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:01.155462 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1439/2851] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:39:01.160270 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:01.174286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d844c-f01c-4e59-a65f-c3660853b324 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:01.180940 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:01.182217 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:01.182552 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:01.182899 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] PATH_INFO: `/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e/users/075e6221fae641718121199e08ebd144/roles/2f3ba2869328424982c43c608f72cb4e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:01.185120 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa70317112b1410d8189a1b8b2ed0f2e, user_id=075e6221fae641718121199e08ebd144, role_id=2f3ba2869328424982c43c608f72cb4e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:01.187994 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:01.200193 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1413/2852] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:39:01 2022] PUT /identity/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e/users/075e6221fae641718121199e08ebd144/roles/2f3ba2869328424982c43c608f72cb4e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:39:01.978620 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:01.980509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:02.038534 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:02.052988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5429-42ee-4f14-9f35-28d93f648df2 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:02.113277 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:02.114081 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:02.114430 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:02.114777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:02.117188 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:02.133838 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:02.135723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1a8c9-8ab8-4beb-a423-fadfcb546173 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:02.148819 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1440/2853] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:02.899141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:02.901118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:02.922106 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:03.019513 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20753a-cf71-4b3d-8107-10f7b6762fa7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:03.041247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:03.042257 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:03.042733 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:03.043316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:03.045782 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:03.065643 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:03.068661 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:03.108679 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1414/2854] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:06.945090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde519-3d65-411a-963d-87563b9ce5e7 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:06.945564 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde519-3d65-411a-963d-87563b9ce5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:06.945688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde519-3d65-411a-963d-87563b9ce5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:06.982263 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-58cde519-3d65-411a-963d-87563b9ce5e7 None None] MFA Rules not processed for user `075e6221fae641718121199e08ebd144`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:06.983699 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-58cde519-3d65-411a-963d-87563b9ce5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:07.065496 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1441/2855] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:07.081168 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:07.082623 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:07.158133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97bf85-cc74-4717-b92e-6c621e3e6b28 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:07.163175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3b4e1e918440858a0f10b8eadb4f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:07.163932 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:07.164312 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:07.164664 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:07.240510 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:07.242192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:07.264172 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1415/2856] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:07.399599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:07.399962 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:07.400211 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:07.429247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:07.431232 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:07.519409 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1442/2857] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:39:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:07.571992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:07.574314 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:07.651165 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:07.671498 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50059a-d899-41df-b7c4-5d6cb650892c service glance] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:07.676835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:07.677690 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:07.677979 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:07.678390 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:07.687865 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:07.692998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:07.702060 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1416/2858] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:39:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:39:07.897464 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:07.899268 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:07.951613 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:08.009562 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c402-4ffd-4ca6-a4c3-e10ac975f6d4 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:08.015167 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:08.016383 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:08.016899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:08.017406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] PATH_INFO: `/v3/users/4ba1f96d20484396bab123a7635bc735` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:08.018858 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba1f96d20484396bab123a7635bc735)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:08.022365 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:08.083247 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba1f96d20484396bab123a7635bc735'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.084004 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba1f96d20484396bab123a7635bc735'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.091389 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba1f96d20484396bab123a7635bc735'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.103899 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba1f96d20484396bab123a7635bc735'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.104658 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba1f96d20484396bab123a7635bc735'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.128755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1443/2859] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:39:07 2022] DELETE /identity/v3/users/4ba1f96d20484396bab123a7635bc735 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:39:08.410280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:08.425327 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97fe57-ef93-4481-879c-16bc4e9503e7 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:08.503900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:08.505915 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:08.506306 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:08.506620 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] PATH_INFO: `/v3/projects/66e0db41a73c419ab17ad0ae7b03097e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:08.507921 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e0db41a73c419ab17ad0ae7b03097e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:08.510031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:08.575583 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e0db41a73c419ab17ad0ae7b03097e', 'request_id': 'req-631eb1c2-f189-4a93-8f1e-905bd70a9785'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.585641 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e0db41a73c419ab17ad0ae7b03097e', 'request_id': 'req-631eb1c2-f189-4a93-8f1e-905bd70a9785'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.593654 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e0db41a73c419ab17ad0ae7b03097e', 'request_id': 'req-631eb1c2-f189-4a93-8f1e-905bd70a9785'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.628436 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] The token cache is being invalidate because project 66e0db41a73c419ab17ad0ae7b03097e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:39:08.629883 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.633588 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.636531 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1417/2860] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:39:08 2022] DELETE /identity/v3/projects/66e0db41a73c419ab17ad0ae7b03097e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:39:08.641502 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:08.642978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:08.663776 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb727-f0ce-4466-ad1b-59774092b4e6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:08.758255 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:08.762056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:08.762394 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:08.762616 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] PATH_INFO: `/v3/users/c6714a7c37474c449f79d4125b24b699` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:08.763999 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6714a7c37474c449f79d4125b24b699)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:08.766064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:08.867059 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6714a7c37474c449f79d4125b24b699'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.867816 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6714a7c37474c449f79d4125b24b699'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.873756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:08.875988 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6714a7c37474c449f79d4125b24b699'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.896565 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6714a7c37474c449f79d4125b24b699'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.897352 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-21159f81-3c8b-41ec-baf0-228e63b2b0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6714a7c37474c449f79d4125b24b699'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:08.936933 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1444/2861] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:39:08 2022] DELETE /identity/v3/users/c6714a7c37474c449f79d4125b24b699 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:39:09.155667 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:09.157347 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:09.184855 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eb1c2-f189-4a93-8f1e-905bd70a9785 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:09.286824 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:09.287974 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:09.288476 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:09.288928 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] PATH_INFO: `/v3/projects/702f1ebdf6024cb49a0945988c414ce2` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:09.290334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=702f1ebdf6024cb49a0945988c414ce2)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:09.292479 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:09.313310 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:09.377438 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702f1ebdf6024cb49a0945988c414ce2', 'request_id': 'req-675ad82e-23ee-4362-85a3-655b73a7b70f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:09.388142 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702f1ebdf6024cb49a0945988c414ce2', 'request_id': 'req-675ad82e-23ee-4362-85a3-655b73a7b70f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:09.394337 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702f1ebdf6024cb49a0945988c414ce2', 'request_id': 'req-675ad82e-23ee-4362-85a3-655b73a7b70f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:09.407045 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] The token cache is being invalidate because project 702f1ebdf6024cb49a0945988c414ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:39:09.407477 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:09.408278 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:39:09.410141 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1418/2862] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:39:09 2022] DELETE /identity/v3/projects/702f1ebdf6024cb49a0945988c414ce2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:39:14.382702 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b63c-f603-4678-b428-3238e37f44bf None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:14.383159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b63c-f603-4678-b428-3238e37f44bf None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:14.383257 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b63c-f603-4678-b428-3238e37f44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:14.402978 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-c325b63c-f603-4678-b428-3238e37f44bf None None] MFA Rules not processed for user `fbb3e0a13ac34245a36e4dfb2f81df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:14.404425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-c325b63c-f603-4678-b428-3238e37f44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:14.470654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1445/2863] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:14.734587 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:14.736112 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:14.807577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ad82e-23ee-4362-85a3-655b73a7b70f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:14.814299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:14.814956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:14.815238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:14.815514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:14.818016 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:14.828953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:14.830419 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5470f-9f1d-4feb-bc4e-9240369ea63e service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:14.839689 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1419/2864] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:17.507772 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:17.508276 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:17.508398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:17.529084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] MFA Rules not processed for user `104b4ec7f3924f0ba5d505ddbb0da19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:17.530291 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:17.594146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1446/2865] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:21.110835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:21.111305 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:21.111399 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:21.129046 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:21.130246 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:21.185998 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1420/2866] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:21.198210 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:21.199591 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:21.277727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9280f1-f022-4f58-b276-1ca13e011465 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:21.283084 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:21.283727 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:21.284009 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:21.284310 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:21.293626 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:21.295220 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e2fd5-70dc-4f93-8fca-a0c92c5d428f service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:21.304090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1447/2867] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:39:23.494263 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:23.496876 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:23.577143 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:23.605397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b964281-c0cc-404c-a934-d325907cd37e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:23.610800 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:23.611445 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:23.611726 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:23.612000 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:23.614311 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:23.626220 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:23.627797 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:23.638873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1421/2868] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:31.300686 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:33.634447 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=11 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:43.753008 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:43.753545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:43.753545 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:43.771388 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:43.773703 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:43.781623 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1448/2869] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:39:43.794146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:43.805852 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221bc3-8428-49df-b29f-f4e5e3d1a833 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:43.811289 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:43.812149 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:43.812431 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:43.812704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:43.821489 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:43.823162 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96932c39-d448-4638-8018-fa366e73d686 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:43.831350 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1422/2870] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:39:51.635743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:51.646332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef91d-00e7-4214-963b-d7f3ad70be27 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:51.650787 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:51.651539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:51.651920 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:51.652330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:51.654342 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:51.724801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:51.727024 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:51.738042 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1449/2871] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:39:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:39:53.828091 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:39:59.405086 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:59.405750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:59.405750 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:59.424095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:39:59.425285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:39:59.433335 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1423/2872] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:39:59.445916 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:39:59.457158 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad06329-60fa-4011-8bbb-714b45946136 service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:39:59.462130 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:39:59.462784 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:39:59.463067 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:39:59.463345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:39:59.471318 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:39:59.472930 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:39:59.481736 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1450/2873] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:40:01.410595 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:01.412062 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:01.485833 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcd5e-40b0-4b52-961e-51d8b6504a73 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:01.490373 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:01.491266 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:01.491548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:01.491818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] PATH_INFO: `/v3/users/fbb3e0a13ac34245a36e4dfb2f81df2d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:01.493059 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb3e0a13ac34245a36e4dfb2f81df2d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:01.494985 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:01.549761 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb3e0a13ac34245a36e4dfb2f81df2d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.556722 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb3e0a13ac34245a36e4dfb2f81df2d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.557380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb3e0a13ac34245a36e4dfb2f81df2d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.557977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb3e0a13ac34245a36e4dfb2f81df2d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.566807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8c3cfa17-49fa-47b9-8854-a56ec36b7000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb3e0a13ac34245a36e4dfb2f81df2d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.587435 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1424/2874] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:40:01 2022] DELETE /identity/v3/users/fbb3e0a13ac34245a36e4dfb2f81df2d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:01.778491 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:01.789606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582a32-d099-4d9d-993c-af2be9f5fe2e service swift] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:01.848619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:01.849500 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:01.849758 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:01.850064 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] PATH_INFO: `/v3/projects/67b6515d1a9f462d940ff85e6e4a243d` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:01.851447 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b6515d1a9f462d940ff85e6e4a243d)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:01.853748 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:01.898553 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b6515d1a9f462d940ff85e6e4a243d', 'request_id': 'req-d6698164-2eeb-4688-8416-fc3025be8d3d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.903801 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b6515d1a9f462d940ff85e6e4a243d', 'request_id': 'req-d6698164-2eeb-4688-8416-fc3025be8d3d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.910918 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b6515d1a9f462d940ff85e6e4a243d', 'request_id': 'req-d6698164-2eeb-4688-8416-fc3025be8d3d'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.921762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] The token cache is being invalidate because project 67b6515d1a9f462d940ff85e6e4a243d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:40:01.922075 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.922720 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-d6698164-2eeb-4688-8416-fc3025be8d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:01.924289 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1451/2875] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:40:01 2022] DELETE /identity/v3/projects/67b6515d1a9f462d940ff85e6e4a243d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:01.930675 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:01.930968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:01.931249 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:01.949288 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:01.950490 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.008872 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1425/2876] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:02.016619 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.017134 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.017425 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.024968 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:02.037835 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:02.039127 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.047213 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1452/2877] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:02.051524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.061668 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d44b3-de6f-404e-8130-82e78a696ffc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.066192 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.066826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.067103 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.067375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.068118 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:40:02.068423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.070577 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.079052 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:02.083038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1426/2878] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:40:02.087290 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.096735 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222d75-3b30-4f76-9ac8-1aa94610ea70 None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.101386 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.102020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.102316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.102571 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.103517 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.105454 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.130166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1453/2879] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:40:02 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:40:02.134809 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.144684 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fce6e-44cb-4883-82d2-0da5ab4390fa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.198851 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.199427 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.199705 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.199973 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.200687 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.202605 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.226642 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1427/2880] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:40:02 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:40:02.227804 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.238716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11172c8-0792-46ed-9546-c727a78815f9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.243897 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.244577 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.244860 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.245135 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.245857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.247457 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.258421 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1454/2881] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 14:40:02.262355 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.272374 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641a3f-e791-4afd-8b40-630d67f45c84 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.276905 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.277541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.277832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.278097 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.278813 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.280440 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69d32-9a59-4607-8b76-405a69ff5cae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.290776 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1428/2882] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:40:02.294745 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.305242 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c222ba-b139-4d12-9a92-e2c73e5b71ad admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.309852 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.310790 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.311103 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.311506 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] PATH_INFO: `/v3/projects/651556534b314f288d634f3f9ff4cfde/users/f6d66723c60b4db294e6c3d76dacc8aa/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.326416 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651556534b314f288d634f3f9ff4cfde, user_id=f6d66723c60b4db294e6c3d76dacc8aa, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.329097 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.341672 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1455/2883] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:40:02 2022] PUT /identity/v3/projects/651556534b314f288d634f3f9ff4cfde/users/f6d66723c60b4db294e6c3d76dacc8aa/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:02.352434 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.352720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.353256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.380238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] MFA Rules not processed for user `f6d66723c60b4db294e6c3d76dacc8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:02.381449 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.443285 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1429/2884] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:02.454260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.455884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.512508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5b04-9dec-4232-a9d7-a10461d89357 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.516123 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.516761 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.517041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.517316 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.525398 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.526847 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ba76-796b-4057-b573-968a9c8ef568 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.535419 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1456/2885] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:40:02.560316 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.621380 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50930-0ebd-4300-8081-8ca915b0e493 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.625896 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.626758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.627037 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.627313 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] PATH_INFO: `/v3/users/f6d66723c60b4db294e6c3d76dacc8aa` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.628532 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d66723c60b4db294e6c3d76dacc8aa)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.630446 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.640720 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:02.677575 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d66723c60b4db294e6c3d76dacc8aa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:02.684922 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d66723c60b4db294e6c3d76dacc8aa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:02.685652 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d66723c60b4db294e6c3d76dacc8aa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:02.686260 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d66723c60b4db294e6c3d76dacc8aa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:02.693541 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d66723c60b4db294e6c3d76dacc8aa'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:02.711462 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1430/2886] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:40:02 2022] DELETE /identity/v3/users/f6d66723c60b4db294e6c3d76dacc8aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:02.715971 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.716300 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.716582 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.734060 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:02.735243 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.792732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1457/2887] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 14:40:02.802286 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:02.803758 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:02.871571 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d13070-0e32-4388-a0a5-e6f1cb52b176 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:02.875176 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:02.875811 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:02.876117 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:02.876391 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:02.885408 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:02.886828 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a6725-6912-43fa-aa1c-b29cbbef20db service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:02.896110 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1431/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:40:03.166876 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.168319 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:03.180654 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852af2-c6dc-411c-bde4-0142fe82c89f None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.185204 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.186056 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.186330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.186599 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] PATH_INFO: `/v3/projects/651556534b314f288d634f3f9ff4cfde` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.187777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=651556534b314f288d634f3f9ff4cfde)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.189947 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.232777 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:03.241653 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651556534b314f288d634f3f9ff4cfde', 'request_id': 'req-69fc44bf-9c83-482d-9e35-20058ace9dfe'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:03.247410 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651556534b314f288d634f3f9ff4cfde', 'request_id': 'req-69fc44bf-9c83-482d-9e35-20058ace9dfe'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:03.254614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651556534b314f288d634f3f9ff4cfde', 'request_id': 'req-69fc44bf-9c83-482d-9e35-20058ace9dfe'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:03.266260 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] The token cache is being invalidate because project 651556534b314f288d634f3f9ff4cfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:40:03.266546 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:03.267182 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-69fc44bf-9c83-482d-9e35-20058ace9dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:03.268786 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1458/2889] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:40:03 2022] DELETE /identity/v3/projects/651556534b314f288d634f3f9ff4cfde => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:03.274258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.274548 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.274826 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.292001 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:03.293219 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:03.351175 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1432/2890] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:03.359074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.359363 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.359641 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.377505 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:03.378751 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:03.387099 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1459/2891] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:03.391067 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.401570 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278038fb-c81c-410b-bff1-ce85b928f110 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.406284 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.406931 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.407212 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.407484 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.408238 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:40:03.408542 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.410146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.422011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1433/2892] 10.222.0.13 () {58 vars in 1152 bytes} [Fri Jun 24 14:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:40:03.426347 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.436102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dcff3-5818-4fac-bf45-90b8e82c244c None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.440821 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.441461 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.441743 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.442021 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.442700 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.445275 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.475732 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1460/2893] 10.222.0.13 () {60 vars in 1152 bytes} [Fri Jun 24 14:40:03 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:40:03.480198 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.490911 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc212a2e-e53b-4b1d-a223-524ead9f55d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.503134 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:03.550832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.551538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.551830 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.552169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.552867 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.557164 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.577287 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1434/2894] 10.222.0.13 () {60 vars in 1143 bytes} [Fri Jun 24 14:40:03 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:40:03.581400 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.591684 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541c79-1684-495b-9a3e-9bd1d9b499d6 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.596477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.597146 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.597478 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.597775 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.598509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.600207 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.610723 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1461/2895] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:40:03.614714 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.625448 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74c18-050b-43d3-8ea2-5a87e33223f3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.630056 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.630702 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.630986 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.631832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.632596 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.634195 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef304c5-2ce1-4dd6-9328-3ccc68d25bc1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.643924 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1435/2896] 10.222.0.13 () {58 vars in 1121 bytes} [Fri Jun 24 14:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 14:40:03.647882 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.657675 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cebc-7811-4456-a477-97c4ad8aa473 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.662791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.663662 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.663943 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.664250 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] PATH_INFO: `/v3/projects/089fcef5628549938908c7f3d9baf358/users/4f9da5d53d154e72a1cf854d1e94fe70/roles/2bfcd0e9346b4c9cb796e54313815a05` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.679030 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089fcef5628549938908c7f3d9baf358, user_id=4f9da5d53d154e72a1cf854d1e94fe70, role_id=2bfcd0e9346b4c9cb796e54313815a05)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.681756 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.695341 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1462/2897] 10.222.0.13 () {60 vars in 1482 bytes} [Fri Jun 24 14:40:03 2022] PUT /identity/v3/projects/089fcef5628549938908c7f3d9baf358/users/4f9da5d53d154e72a1cf854d1e94fe70/roles/2bfcd0e9346b4c9cb796e54313815a05 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:03.705524 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc416-1222-4068-9764-856ef4e8f48b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.705818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc416-1222-4068-9764-856ef4e8f48b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.706095 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc416-1222-4068-9764-856ef4e8f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.732786 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1c2cc416-1222-4068-9764-856ef4e8f48b None None] MFA Rules not processed for user `4f9da5d53d154e72a1cf854d1e94fe70`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:03.733981 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1c2cc416-1222-4068-9764-856ef4e8f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:03.799099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1436/2898] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:03.810467 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:03.812254 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:03.869774 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267620f-f264-4004-a5de-3fb82088ecd3 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:03.873379 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d9764e77334bfba5bf18cdb026bd51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:03.874018 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:03.874301 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:03.874578 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:03.882809 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:03.884271 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e6141-4e63-43d3-89ab-f05522a9cf12 service cinder] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:03.892984 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1463/2899] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:40:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:40:05.279247 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:05.279799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:05.279799 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:05.297031 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] MFA Rules not processed for user `4f9da5d53d154e72a1cf854d1e94fe70`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:05.298216 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:05.305526 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1437/2900] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:13.889116 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:15.291859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:22.290606 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389c5a-be91-42c7-8af2-0dd60854dbce None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:22.291049 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389c5a-be91-42c7-8af2-0dd60854dbce None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:22.291164 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389c5a-be91-42c7-8af2-0dd60854dbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:22.308345 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-1d389c5a-be91-42c7-8af2-0dd60854dbce None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:22.309527 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-1d389c5a-be91-42c7-8af2-0dd60854dbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:22.363477 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1464/2901] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:22.385111 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:22.386488 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:22.453640 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48203-7e7e-4a20-94bb-77bdb84a093e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:22.458835 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:22.459464 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:22.459748 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:22.460041 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:22.468071 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:22.469647 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:22.477681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1438/2902] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:40:22.985392 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244f3dc-3e28-4f77-9865-6e4f8c0df801 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:22.985710 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244f3dc-3e28-4f77-9865-6e4f8c0df801 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:22.985990 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244f3dc-3e28-4f77-9865-6e4f8c0df801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.003406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-8244f3dc-3e28-4f77-9865-6e4f8c0df801 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:23.004670 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-8244f3dc-3e28-4f77-9865-6e4f8c0df801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:23.011668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1465/2903] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:23.024557 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:23.044244 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bc05-bb54-4e45-9587-7796bbb8a194 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:23.049309 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:23.049952 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:23.050236 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:23.050515 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.058968 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:23.060622 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:23.068681 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1439/2904] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:40:23.255494 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1cbc-5d89-4ca3-bdb3-18eeab1cef28 None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:23.255778 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1cbc-5d89-4ca3-bdb3-18eeab1cef28 None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:23.256082 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1cbc-5d89-4ca3-bdb3-18eeab1cef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.275923 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-0b7e1cbc-5d89-4ca3-bdb3-18eeab1cef28 None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:23.277124 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-0b7e1cbc-5d89-4ca3-bdb3-18eeab1cef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:23.284102 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1466/2905] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Jun 24 14:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:23.295785 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:23.306397 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddbd92-b01e-48ca-9010-501d9ddc5531 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:23.311334 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:23.311956 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:23.312279 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:23.312558 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.321027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:23.322600 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:23.331011 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1440/2906] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:40:23.650965 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] REQUEST_METHOD: `POST` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:23.651429 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:23.651649 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.669330 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.auth.core [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80139) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:23.670498 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:23.677559 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1467/2907] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:23.689209 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:23.699900 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f6d1b-e973-4722-95b3-455463e325ee service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:23.705004 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:23.705628 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:23.705908 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:23.706182 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:23.714551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:23.716170 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65bd38-11e5-4fa2-95f0-f793a12b72e3 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:23.724038 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1441/2908] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:40:25.751332 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:25.816128 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a0bc7-e4c1-4671-98ae-8c7cca16302d None None] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:25.821159 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:25.822016 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:25.822297 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:25.822572 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] PATH_INFO: `/v3/users/4f9da5d53d154e72a1cf854d1e94fe70` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:25.823755 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9da5d53d154e72a1cf854d1e94fe70)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:25.825718 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:25.870435 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9da5d53d154e72a1cf854d1e94fe70'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:25.871079 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9da5d53d154e72a1cf854d1e94fe70'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:25.877823 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9da5d53d154e72a1cf854d1e94fe70'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:25.884843 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9da5d53d154e72a1cf854d1e94fe70'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:25.885511 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9da5d53d154e72a1cf854d1e94fe70'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:25.903280 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1468/2909] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:40:25 2022] DELETE /identity/v3/users/4f9da5d53d154e72a1cf854d1e94fe70 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:25.907763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:25.908317 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:25.908437 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:25.925694 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] MFA Rules not processed for user `35fa0e2d0ac94d528972d6e81d01f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:40:25.926886 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:25.987574 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1442/2910] 10.222.0.13 () {58 vars in 957 bytes} [Fri Jun 24 14:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:40:25.997539 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:25.998934 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:26.005586 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:26.058032 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330af8-6ccc-4cd3-a120-c07a0fcc01b9 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:26.061678 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd505d66500da43eab82b746d7e7d0875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:26.062307 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:26.062587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:26.062855 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:26.072357 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:26.073783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:26.082980 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1469/2911] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:40:26.248832 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:40:26.250992 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:40:26.266996 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961476-f40d-4c7b-a783-aeda59d0de59 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:40:26.271732 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:40:26.272663 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:40:26.272942 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:40:26.273281 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] PATH_INFO: `/v3/projects/089fcef5628549938908c7f3d9baf358` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:40:26.274439 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=089fcef5628549938908c7f3d9baf358)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:40:26.276354 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:40:26.319721 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:26.322837 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089fcef5628549938908c7f3d9baf358', 'request_id': 'req-f536540e-991e-42cc-941f-ce050cb2efb6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:26.330299 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089fcef5628549938908c7f3d9baf358', 'request_id': 'req-f536540e-991e-42cc-941f-ce050cb2efb6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:26.335975 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089fcef5628549938908c7f3d9baf358', 'request_id': 'req-f536540e-991e-42cc-941f-ce050cb2efb6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:26.346579 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] The token cache is being invalidate because project 089fcef5628549938908c7f3d9baf358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:40:26.346859 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:26.347481 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f536540e-991e-42cc-941f-ce050cb2efb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:40:26.349099 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1443/2912] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:40:26 2022] DELETE /identity/v3/projects/089fcef5628549938908c7f3d9baf358 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:40:36.078857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=24 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:40:36.343763 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:13.035040 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:13.036587 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:13.250717 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01a1-ce6d-408a-802c-3fc98b9ec72f service neutron] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:13.336817 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e00c4684e0645eaa796aa1765f7481e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:13.337677 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:13.338206 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:13.338574 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:13.340857 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:13.357504 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:13.359463 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:13.374248 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1470/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:42:20.665342 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:20.665807 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:20.665904 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:20.722947 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] MFA Rules not processed for user `00ad856d9989434f871d7facb6b69a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:42:20.724183 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:20.788283 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1444/2914] 10.222.0.13 () {58 vars in 967 bytes} [Fri Jun 24 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 14:42:20.832785 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:20.834181 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:20.867369 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=100 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:20.924884 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8ab7-9bb2-4d90-ac6c-c785896570a6 service nova] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:20.929783 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8263daa298542be9a90840f5417e1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:20.930411 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:20.930688 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:20.930957 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:20.939593 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:20.941526 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:20.949640 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1471/2915] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Jun 24 14:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:42:24.246805 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:24.248423 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:24.365012 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ae5ed-e2fd-4f34-bb96-7d6c6d2fa95f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:24.371258 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:24.372197 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:24.372701 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:24.373146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:24.376116 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:24.392538 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:24.395280 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:24.406514 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1445/2916] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:42:27.121126 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:27.133509 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955730-e04d-4629-8eeb-e9b757f1d711 service swift] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:27.140508 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:27.141155 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:27.141437 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:27.141712 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:27.143584 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:27.156538 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:27.158259 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:27.172406 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1472/2917] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:42:27.187226 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:27.188910 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:27.238271 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:27.304610 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d05e3a-724b-499d-85e0-a9938ad7d7a1 service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:27.309207 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:27.310098 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:27.310377 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:27.310650 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] PATH_INFO: `/v3/users/104b4ec7f3924f0ba5d505ddbb0da19f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:27.311818 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104b4ec7f3924f0ba5d505ddbb0da19f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:27.313762 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:27.362206 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104b4ec7f3924f0ba5d505ddbb0da19f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.368875 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104b4ec7f3924f0ba5d505ddbb0da19f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.369551 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104b4ec7f3924f0ba5d505ddbb0da19f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.370146 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104b4ec7f3924f0ba5d505ddbb0da19f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.376861 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104b4ec7f3924f0ba5d505ddbb0da19f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.394230 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1446/2918] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:42:27 2022] DELETE /identity/v3/users/104b4ec7f3924f0ba5d505ddbb0da19f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:42:27.560486 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:27.573176 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9610-c9cb-46f0-b597-af62eca3781a service placement] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:27.629668 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:27.630441 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:27.630719 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:27.630991 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] PATH_INFO: `/v3/projects/c5ee53b145944494b79c33cff7a86c72` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:27.632183 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ee53b145944494b79c33cff7a86c72)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:27.634090 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:27.679288 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ee53b145944494b79c33cff7a86c72', 'request_id': 'req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.684791 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ee53b145944494b79c33cff7a86c72', 'request_id': 'req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.692078 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ee53b145944494b79c33cff7a86c72', 'request_id': 'req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.703185 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] The token cache is being invalidate because project c5ee53b145944494b79c33cff7a86c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:42:27.703485 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.704139 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.705661 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1473/2919] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:42:27 2022] DELETE /identity/v3/projects/c5ee53b145944494b79c33cff7a86c72 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:42:27.709728 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:27.711133 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:27.724486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcad7b-460c-423a-b975-38bd0f7f88c7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:27.779368 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:27.780256 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:27.780535 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:27.780806 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] PATH_INFO: `/v3/users/075e6221fae641718121199e08ebd144` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:27.781977 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075e6221fae641718121199e08ebd144)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:27.783878 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:27.810509 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:27.830129 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075e6221fae641718121199e08ebd144'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.837027 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075e6221fae641718121199e08ebd144'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.837873 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075e6221fae641718121199e08ebd144'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.838499 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075e6221fae641718121199e08ebd144'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.846239 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075e6221fae641718121199e08ebd144'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:27.863953 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1447/2920] 10.222.0.13 () {58 vars in 1223 bytes} [Fri Jun 24 14:42:27 2022] DELETE /identity/v3/users/075e6221fae641718121199e08ebd144 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:42:28.031557 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:28.033073 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:28.047833 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f36d-8d6c-42a2-bc4d-eefcbccad703 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:28.061020 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:28.108904 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35fa0e2d0ac94d528972d6e81d01f77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece624c61ff74175ac0fde255f3115b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:28.109762 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:28.110041 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:28.110311 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] PATH_INFO: `/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:28.111519 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa70317112b1410d8189a1b8b2ed0f2e)` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:28.113481 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:28.159614 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa70317112b1410d8189a1b8b2ed0f2e', 'request_id': 'req-cef493fc-0c1f-4cc7-8111-9128afc09689'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:28.164959 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa70317112b1410d8189a1b8b2ed0f2e', 'request_id': 'req-cef493fc-0c1f-4cc7-8111-9128afc09689'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:28.172375 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa70317112b1410d8189a1b8b2ed0f2e', 'request_id': 'req-cef493fc-0c1f-4cc7-8111-9128afc09689'} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:28.183436 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] The token cache is being invalidate because project aa70317112b1410d8189a1b8b2ed0f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80139) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 14:42:28.183716 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:28.184358 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.notifications [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80139) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 14:42:28.185889 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1474/2921] 10.222.0.13 () {58 vars in 1232 bytes} [Fri Jun 24 14:42:28 2022] DELETE /identity/v3/projects/aa70317112b1410d8189a1b8b2ed0f2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:42:30.425169 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:42:30.426704 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:30.506486 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238356-b50b-4792-aea9-8b4b451164d9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:42:30.567433 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:42:30.568048 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:42:30.568338 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:42:30.568611 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:42:30.570375 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:42:30.582318 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:42:30.583988 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad431c-a0cb-499a-9502-4ce8644bca47 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:42:30.599853 dv-cinder-844601-5-smb devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1448/2922] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 14:42:38.180378 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG dbcounter [-] [80139] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:42:40.591410 dv-cinder-844601-5-smb devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=6,keystone:SELECT=77,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:47:37.447166 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Authenticating user token {{(pid=80139) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:47:37.448600 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.fernet_utils [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80139) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:47:37.464074 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef493fc-0c1f-4cc7-8111-9128afc09689 admin admin] Validating token access rules against request {{(pid=80139) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:47:37.468954 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3da23fe1a18462896bc021aa76561ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '912fcc6757544c8c817b5439d78b9b05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80139) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:47:37.469607 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] REQUEST_METHOD: `GET` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:47:37.469886 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] SCRIPT_NAME: `/identity` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:47:37.470160 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80139) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:47:37.480113 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:47:37.481715 dv-cinder-844601-5-smb devstack@keystone.service[80139]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3753-af8b-4f19-a4ab-dd8eed37e69f service placement] RBAC: Authorization granted {{(pid=80139) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:47:37.492612 dv-cinder-844601-5-smb devstack@keystone.service[80139]: [pid: 80139|app: 0|req: 1475/2923] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Jun 24 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)